Nov 02 17:41:09 devstack cinder-volume[75536]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 17:41:09 devstack cinder-volume[75536]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 17:41:09 devstack cinder-volume[75536]: we strongly recommend against using it for new projects. Nov 02 17:41:09 devstack cinder-volume[75536]: If you are already using Eventlet, we recommend migrating to a different Nov 02 17:41:09 devstack cinder-volume[75536]: framework. For more detail see Nov 02 17:41:09 devstack cinder-volume[75536]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 17:41:09 devstack cinder-volume[75536]: import eventlet # noqa Nov 02 17:41:12 devstack cinder-volume[75536]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:41:12 devstack cinder-volume[75536]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:41:12 devstack cinder-volume[75536]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:41:13 devstack cinder-volume[75536]: INFO dbcounter [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Registered counter for database cinder Nov 02 17:41:13 devstack cinder-volume[75536]: DEBUG oslo_db.sqlalchemy.engines [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75536) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:41:13 devstack cinder-volume[75536]: DEBUG dbcounter [-] [75536] Writer thread running {{(pid=75536) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 17:41:13 devstack cinder-volume[75536]: INFO cinder.rpc [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 17:41:13 devstack cinder-volume[75536]: INFO cinder.rpc [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 17:41:13 devstack cinder-volume[75536]: DEBUG oslo_db.sqlalchemy.engines [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75536) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:41:13 devstack cinder-volume[75536]: INFO cinder.volume.manager [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Determined volume DB was empty at startup. Nov 02 17:41:13 devstack cinder-volume[75536]: DEBUG cinder.volume.manager [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75536) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 17:41:13 devstack cinder-volume[75536]: INFO cinder.volume.manager [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 17:41:13 devstack cinder-volume[75536]: WARNING stevedore.named [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 17:41:13 devstack cinder-volume[75536]: WARNING castellan.key_manager [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:41:13 devstack cinder-volume[75536]: WARNING cinder.keymgr.conf_key_mgr [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:41:13 devstack cinder-volume[75536]: DEBUG cinder.volume.drivers.lvm [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75536) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 17:41:13 devstack cinder-volume[75536]: DEBUG oslo_concurrency.processutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_concurrency.processutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] CMD "cinder-rtstool verify" returned: 0 in 0.449s {{(pid=75536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_db.sqlalchemy.engines [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75536) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:41:14 devstack cinder-volume[75536]: INFO cinder.rpc [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 17:41:14 devstack cinder-volume[75536]: INFO cinder.rpc [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 17:41:14 devstack cinder-volume[75536]: WARNING stevedore.named [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 17:41:14 devstack cinder-volume[75536]: WARNING castellan.key_manager [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:41:14 devstack cinder-volume[75536]: INFO cinder.volume.manager [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_db.sqlalchemy.engines [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75536) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:41:14 devstack cinder-volume[75536]: INFO oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Starting 1 workers Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Started child 75702 {{(pid=75536) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Full set of CONF: {{(pid=75536) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] ******************************************************************************** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Configuration options gathered from: {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] ================================================================================ {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] allow_availability_zone_fallback = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] allow_compression_on_image_upload = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] allowed_direct_url_schemes = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] api_rate_limit = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] auth_strategy = keystone {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] az_cache_duration = 3600 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_availability_zone = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_host = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75702]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_stats_polling_interval = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backup_api_class = cinder.backup.api.API {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backup_name_template = backup-%s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backup_use_same_host = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backup_use_temp_snapshot = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] chap_password = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] chap_username = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_internal_tenant_project_id = 86e513e7b4f64869b3eff39898e2aa48 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_internal_tenant_user_id = 154331a236824871809bce1a91288d87 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cloned_volume_same_az = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cluster = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] compression_format = gzip {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] compute_api_class = cinder.compute.nova.API {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] config_dir = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] config_source = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] control_exchange = openstack {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] debug = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] default_availability_zone = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] default_group_type = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] default_volume_type = lvmdriver-1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] disk_geometry = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] driver_client_cert = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] driver_client_cert_key = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] driver_data_namespace = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] driver_ssl_cert_path = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] driver_ssl_cert_verify = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] driver_use_ssl = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] enable_force_upload = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] enable_new_services = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] enable_unsupported_driver = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] enforce_multipath_for_image_xfer = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] filter_function = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_api_insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_api_ssl_compression = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_ca_certificates_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_catalog_info = image:glance:publicURL {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_num_retries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance_request_timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] goodness_function = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] graceful_shutdown_timeout = 5 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] group_api_class = cinder.group.api.API {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] host = devstack {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_compress_on_upload = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_conversion_address_space_limit = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_conversion_cpu_limit = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_conversion_disable = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_introspection_address_space_limit = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_introspection_cpu_limit = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_upload_use_cinder_backend = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_upload_use_internal_tenant = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_volume_cache_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_volume_cache_max_count = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] image_volume_cache_max_size_gb = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] init_host_max_objects_retrieval = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] instance_format = [instance: %(uuid)s] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] iscsi_target_flags = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] iscsi_write_cache = on {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] iser_helper = tgtadm {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] iser_ip_address = 192.168.122.213 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] iser_port = 3260 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_color = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_config_append = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_dir = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_options = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_rotate_interval = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_rotate_interval_type = days {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] log_rotation_type = none {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] max_age = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] max_logfile_count = 30 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] max_logfile_size_mb = 200 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] max_over_subscription_ratio = 20.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] message_reap_interval = 86400 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] message_ttl = 2592000 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] migration_create_volume_timeout_secs = 300 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] monkey_patch = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] monkey_patch_modules = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] my_ip = 192.168.122.213 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] no_snapshot_gb_quota = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] num_iser_scan_tries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] num_shell_tries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] num_volume_device_scan_tries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] nvmeof_conn_info_version = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] nvmet_ns_id = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] nvmet_port_id = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_max_limit = 1000 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_volume_ext_list = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_volume_listen_port = 8776 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_volume_use_ssl = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] osapi_volume_workers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] per_volume_size_limit = -1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] periodic_fuzzy_delay = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] periodic_interval = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] public_endpoint = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] publish_errors = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_backup_gigabytes = 1000 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_backups = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_gigabytes = 1000 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_groups = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_snapshots = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] quota_volumes = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] rate_limit_burst = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] rate_limit_except_level = CRITICAL {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] rate_limit_interval = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] reinit_driver_count = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] replication_device = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] report_discard_supported = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] report_interval = 120 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] reservation_clean_interval = 86400 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] reservation_expire = 86400 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] reserved_image_namespaces = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] reserved_percentage = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] rpc_response_timeout = 120 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] run_external_periodic_tasks = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] scst_target_driver = iscsi {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] scst_target_iqn_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_down_time = 720 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] shell_completion = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] snapshot_name_template = snapshot-%s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] snapshot_same_host = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] split_loggers = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] state_path = /opt/stack/data/cinder {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] storage_availability_zone = nova {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] storage_protocol = iSCSI {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] syslog_log_facility = LOG_USER {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] target_helper = lioadm {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] target_ip_address = 192.168.122.213 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] target_port = 3260 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] target_protocol = iscsi {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] target_secondary_ip_addresses = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] trace_flags = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75702]: INFO cinder.volume.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] transport_url = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] until_refresh = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_chap_auth = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_default_quota_class = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_journal = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_json = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_multipath_for_image_xfer = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_stderr = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] use_syslog = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] verify_glance_signatures = enabled {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_api_class = cinder.volume.api.API {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_backend_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_clear = zero {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_clear_ionice = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_clear_size = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_copy_bps_limit = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_dd_blocksize = 1M {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_name_template = volume-%s {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_service_inithost_offload = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volume_usage_audit_period = month {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] zoning_mode = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_concurrency.disable_process_locking = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.auth_section = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.auth_type = password {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.auth_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.cache = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.include_service_catalog = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.interface = public {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_password = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcache_username = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.region_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.service_type = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.backend = dogpile.cache.null {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.backend_argument = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.backend_expiration_time = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.config_prefix = cache.oslo {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.debug_cache_backend = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.enable_retry_client = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.enable_socket_keepalive = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.expiration_time = 600 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.hashclient_retry_attempts = 2 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_dead_retry = 300 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_pool_maxsize = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_sasl_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.password = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.proxies = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.redis_db = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.redis_server = localhost:6379 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.retry_attempts = 2 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.retry_delay = 0.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.socket_keepalive_count = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.socket_keepalive_idle = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.socket_keepalive_interval = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.socket_timeout = 1.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.tls_allowed_ciphers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.tls_cafile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.tls_certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.tls_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.tls_keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cache.username = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] coordination.backend_url = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.asyncio_connection = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.asyncio_slave_connection = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.backend = sqlalchemy {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.connection = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.connection_debug = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.connection_parameters = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.connection_recycle_time = 3600 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.connection_trace = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.db_inc_retry_interval = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.db_max_retries = 20 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.db_max_retry_interval = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.db_retry_interval = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.max_overflow = 50 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.max_pool_size = 5 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.max_retries = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.mysql_wsrep_sync_wait = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.pool_timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.retry_interval = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.slave_connection = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.sqlite_synchronous = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.synchronous_reader = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] database.use_db_reconnect = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_tracing.insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.connection_string = messaging:// {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.es_doc_type = notification {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.es_scroll_size = 10000 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.es_scroll_time = 2m {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.filter_error_trace = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.hmac_keys = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.sentinel_service_name = mymaster {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.socket_timeout = 0.1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.trace_requests = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler.trace_sqlalchemy = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler_jaeger.process_tags = {} {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler_jaeger.service_name_prefix = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] profiler_otlp.service_name_prefix = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.enforce_new_defaults = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.policy_default_rule = default {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.policy_file = policy.yaml {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.group = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.helper_command = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] privsep_osbrick.user = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.group = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.helper_command = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] cinder_sys_admin.user = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.auth_section = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.auth_type = password {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.cafile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.collect_timing = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.send_service_user_token = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.split_loggers = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.tls_ciphers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] service_user.tls_min_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.auth_section = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.auth_type = password {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.collect_timing = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.region_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.split_loggers = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.tls_ciphers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] glance.tls_min_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.backend_availability_zone = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.chap_password = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.chap_username = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.disk_geometry = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.driver_client_cert = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.driver_client_cert_key = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.driver_data_namespace = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.driver_use_ssl = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.extra_capabilities = {} {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.filter_function = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.goodness_function = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.iscsi_target_flags = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.iscsi_write_cache = on {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.iser_helper = tgtadm {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.iser_port = 3260 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.lvm_share_target = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.lvm_type = auto {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.num_shell_tries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.replication_device = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.report_discard_supported = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.reserved_percentage = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.target_helper = tgtadm {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.target_port = 3260 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.target_protocol = iscsi {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.trace_flags = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.unique_fqdn_network = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.use_chap_auth = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_backend_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_clear = zero {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_clear_ionice = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_clear_size = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_reports.file_event_handler = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_reports.log_dir = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.backend_host = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.chap_password = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.chap_username = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.disk_geometry = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.driver_client_cert = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.extra_capabilities = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.filter_function = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.goodness_function = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.iser_helper = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.iser_ip_address = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.iser_port = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.lvm_share_target = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.lvm_type = auto {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.num_shell_tries = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack sudo[75723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.replication_device = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.report_discard_supported = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.reserved_percentage = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.scst_target_driver = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.storage_protocol = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack sudo[75723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.target_helper = lioadm {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.target_ip_address = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.target_port = 3260 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.trace_flags = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.use_chap_auth = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_clear = zero {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_clear_size = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] lvmdriver-1.volumes_dir = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_notifications.driver = [] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_notifications.retry = -1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] key_manager.fixed_key = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.barbican_api_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.barbican_endpoint = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.barbican_endpoint_type = public {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.barbican_region_name = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.cafile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.collect_timing = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.number_of_retries = 60 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.retry_delay = 1 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.send_service_user_token = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.split_loggers = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.tls_ciphers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.tls_min_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.verify_ssl = True {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican.verify_ssl_path = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.auth_section = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.auth_type = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.cafile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.certfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.collect_timing = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.insecure = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.keyfile = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.split_loggers = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.timeout = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.tls_ciphers = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] barbican_service_user.tls_min_version = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.approle_role_id = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.approle_secret_id = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.auth_method = approle {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.auth_path = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.kv_mountpoint = secret {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.kv_path = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.kv_version = 2 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.namespace = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.root_token_id = **** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.ssl_ca_crt_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.timeout = 60.0 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.token_file = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.token_role = None {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.use_ssl = False {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:41:14 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] ******************************************************************************** {{(pid=75536) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 17:41:15 devstack sudo[75723]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:15 devstack sudo[75866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:15 devstack sudo[75866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:15 devstack sudo[75866]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.265s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:41:15 devstack cinder-volume[75702]: INFO cinder.brick.local_dev.lvm [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:15 devstack sudo[75951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:41:15 devstack sudo[75951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:15 devstack sudo[75951]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG cinder.brick.local_dev.lvm [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75702) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 17:41:15 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:15 devstack sudo[76041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:15 devstack sudo[76041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:16 devstack sudo[76041]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:16 devstack sudo[76225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:16 devstack sudo[76225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:16 devstack sudo[76225]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:16 devstack sudo[76313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 17:41:16 devstack sudo[76313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:16 devstack sudo[76313]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.260s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:16 devstack sudo[76316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:41:16 devstack sudo[76316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:16 devstack sudo[76316]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:16 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:17 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:41:17 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:17 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:17 devstack sudo[76403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:17 devstack sudo[76403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:17 devstack sudo[76403]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:17 devstack sudo[76489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:17 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:17 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:17 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:17 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:17 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:18 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:18 devstack cinder-volume[75702]: INFO cinder.volume.drivers.lvm [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:18 devstack sudo[76506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:18 devstack sudo[76506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:18 devstack sudo[76506]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:18 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:41:18 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:18 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:18 devstack sudo[76512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:18 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:18 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:18 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:18 devstack sudo[76515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:18 devstack sudo[76515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:19 devstack sudo[76515]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:19 devstack sudo[76518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:19 devstack sudo[76518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:19 devstack sudo[76518]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:19 devstack cinder-volume[75702]: INFO cinder.volume.driver [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Driver hasn't implemented _init_vendor_properties() Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG cinder.volume.driver [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75702) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_db.sqlalchemy.engines [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75702) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writer thread running {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG cinder.db.api [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Building query based on filter {{(pid=75702) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG cinder.image.image_utils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75702) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 17:41:19 devstack cinder-volume[75702]: INFO cinder.keymgr.migration [None req-7c3aca80-6f3f-422c-aa5e-2430fb90944b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:19 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:41:19 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:19 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:19 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:19 devstack sudo[76526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:19 devstack sudo[76526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:20 devstack sudo[76526]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:20 devstack sudo[76530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:20 devstack sudo[76530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:20 devstack sudo[76530]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:20 devstack sudo[76533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:20 devstack sudo[76533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:20 devstack sudo[76533]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG cinder.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Notifying Schedulers of capabilities ... {{(pid=75702) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:41:20 devstack cinder-volume[75702]: INFO cinder.volume.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Driver initialization completed successfully. Nov 02 17:41:20 devstack cinder-volume[75702]: INFO cinder.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Initiating service 2 cleanup Nov 02 17:41:20 devstack cinder-volume[75702]: INFO cinder.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Service 2 cleanup completed. Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG cinder.service [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Creating RPC server for service cinder-volume {{(pid=75702) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG cinder.service [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75702) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 17:41:20 devstack cinder-volume[75702]: INFO cinder.volume.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:41:20 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:20 devstack sudo[76539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:41:20 devstack sudo[76539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:21 devstack sudo[76539]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:21 devstack sudo[76544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:21 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:21 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:21 devstack sudo[76547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:41:21 devstack sudo[76547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:21 devstack sudo[76547]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:41:21 devstack sudo[76550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:41:21 devstack sudo[76550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:41:21 devstack sudo[76550]: pam_unix(sudo:session): session closed for user root Nov 02 17:41:21 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:41:22 devstack cinder-volume[75702]: INFO cinder.volume.manager [None req-1d6a0374-0eb2-400a-9952-0692e0daaadf None None] Driver post RPC initialization completed successfully. Nov 02 17:41:24 devstack cinder-volume[75536]: DEBUG dbcounter [-] [75536] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75536) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:41:26 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager._thread_info {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:41:26 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread count: 6 {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:41:26 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread info: [<_MainThread(MainThread, started 129587677094016)>, , , , , ] {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:41:31 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writing DB stats cinder:SELECT=4 {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:41:32 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:42:26 devstack sudo[78667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:42:26 devstack sudo[78667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:42:26 devstack sudo[78667]: pam_unix(sudo:session): session closed for user root Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:42:26 devstack sudo[78687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:42:26 devstack sudo[78687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:42:26 devstack sudo[78687]: pam_unix(sudo:session): session closed for user root Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:42:26 devstack sudo[78690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:42:26 devstack sudo[78690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:42:26 devstack sudo[78690]: pam_unix(sudo:session): session closed for user root Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:42:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:42:26 devstack sudo[78803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:42:26 devstack sudo[78803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:42:27 devstack sudo[78803]: pam_unix(sudo:session): session closed for user root Nov 02 17:42:27 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:42:27 devstack cinder-volume[75702]: DEBUG cinder.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Notifying Schedulers of capabilities ... {{(pid=75702) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:42:27 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager._thread_info {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:42:27 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread count: 6 {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:42:27 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread info: [<_MainThread(MainThread, started 129587677094016)>, , , , , ] {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:43:26 devstack sudo[81932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:43:26 devstack sudo[81932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:43:26 devstack sudo[81932]: pam_unix(sudo:session): session closed for user root Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:43:26 devstack sudo[81935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:43:26 devstack sudo[81935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:43:26 devstack sudo[81935]: pam_unix(sudo:session): session closed for user root Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:43:26 devstack sudo[81938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:43:26 devstack sudo[81938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:43:26 devstack sudo[81938]: pam_unix(sudo:session): session closed for user root Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:43:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:43:26 devstack sudo[81941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:43:26 devstack sudo[81941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:43:27 devstack sudo[81941]: pam_unix(sudo:session): session closed for user root Nov 02 17:43:27 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:43:27 devstack cinder-volume[75702]: DEBUG cinder.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Notifying Schedulers of capabilities ... {{(pid=75702) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:43:27 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager._thread_info {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:43:27 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread count: 6 {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:43:27 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread info: [<_MainThread(MainThread, started 129587677094016)>, , , , , ] {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:43:32 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writing DB stats cinder:SELECT=1 {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:43:32 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writing DB stats cinder:UPDATE=1 {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:44:26 devstack sudo[84089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:44:26 devstack sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:44:26 devstack sudo[84089]: pam_unix(sudo:session): session closed for user root Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:44:26 devstack sudo[84115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:44:26 devstack sudo[84115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:44:26 devstack sudo[84115]: pam_unix(sudo:session): session closed for user root Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:44:26 devstack sudo[84118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:44:26 devstack sudo[84118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:44:26 devstack sudo[84118]: pam_unix(sudo:session): session closed for user root Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.234s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:44:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:44:26 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:44:26 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:44:27 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Nov 02 17:44:27 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:44:27 devstack cinder-volume[75702]: DEBUG cinder.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Notifying Schedulers of capabilities ... {{(pid=75702) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG cinder.volume.drivers.lvm [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Updating volume stats {{(pid=75702) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:26 devstack sudo[85333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 17:45:26 devstack sudo[85333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:26 devstack sudo[85333]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:26 devstack sudo[85336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:45:26 devstack sudo[85336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:26 devstack sudo[85336]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:26 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 17:45:26 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:26 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:26 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:26 devstack sudo[85365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 17:45:26 devstack sudo[85365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:27 devstack sudo[85365]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:27 devstack cinder-volume[75702]: DEBUG oslo_concurrency.processutils [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75702) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:27 devstack cinder-volume[75702]: DEBUG cinder.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Notifying Schedulers of capabilities ... {{(pid=75702) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:45:27 devstack cinder-volume[75702]: DEBUG oslo_service.periodic_task [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] Running periodic task VolumeManager._thread_info {{(pid=75702) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:45:27 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread count: 6 {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:45:27 devstack cinder-volume[75702]: DEBUG cinder.volume.manager [None req-6168625a-6ac4-4a1d-b401-baefd34f4a87 None None] thread info: [<_MainThread(MainThread, started 129587677094016)>, , , , , ] {{(pid=75702) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:45:32 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writing DB stats cinder:SELECT=1 {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:45:32 devstack cinder-volume[75702]: DEBUG dbcounter [-] [75702] Writing DB stats cinder:UPDATE=1 {{(pid=75702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:45:38 devstack cinder-volume[75536]: INFO oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Caught SIGTERM, stopping children Nov 02 17:45:38 devstack cinder-volume[75536]: DEBUG oslo_concurrency.lockutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Acquiring lock "singleton_lock" {{(pid=75536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:45:38 devstack cinder-volume[75536]: DEBUG oslo_concurrency.lockutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Acquired lock "singleton_lock" {{(pid=75536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:45:38 devstack cinder-volume[75536]: DEBUG oslo_concurrency.lockutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Releasing lock "singleton_lock" {{(pid=75536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:45:38 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Stop services. {{(pid=75536) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 17:45:38 devstack cinder-volume[75536]: DEBUG oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Killing children. {{(pid=75536) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 17:45:38 devstack cinder-volume[75536]: INFO oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Waiting on 1 children to exit Nov 02 17:45:40 devstack cinder-volume[75702]: DEBUG oslo_concurrency.lockutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Acquiring lock "singleton_lock" {{(pid=75702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:45:40 devstack cinder-volume[75702]: DEBUG oslo_concurrency.lockutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Acquired lock "singleton_lock" {{(pid=75702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:45:40 devstack cinder-volume[75702]: DEBUG oslo_concurrency.lockutils [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Releasing lock "singleton_lock" {{(pid=75702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:45:40 devstack cinder-volume[75702]: WARNING amqp [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 17:45:40 devstack cinder-volume[75702]: WARNING amqp [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 17:45:40 devstack cinder-volume[75536]: INFO oslo_service.backend._eventlet.service [None req-37d6a164-763a-40eb-a2e1-d4f3ef77d60d None None] Child 75702 exited with status 0 Nov 02 17:45:41 devstack cinder-volume[85741]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 17:45:41 devstack cinder-volume[85741]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 17:45:41 devstack cinder-volume[85741]: we strongly recommend against using it for new projects. Nov 02 17:45:41 devstack cinder-volume[85741]: If you are already using Eventlet, we recommend migrating to a different Nov 02 17:45:41 devstack cinder-volume[85741]: framework. For more detail see Nov 02 17:45:41 devstack cinder-volume[85741]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 17:45:41 devstack cinder-volume[85741]: import eventlet # noqa Nov 02 17:45:43 devstack cinder-volume[85741]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:45:43 devstack cinder-volume[85741]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:45:43 devstack cinder-volume[85741]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:45:43 devstack cinder-volume[85741]: INFO dbcounter [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Registered counter for database cinder Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_db.sqlalchemy.engines [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG dbcounter [-] [85741] Writer thread running {{(pid=85741) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 17:45:44 devstack cinder-volume[85741]: INFO cinder.rpc [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 17:45:44 devstack cinder-volume[85741]: INFO cinder.rpc [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_db.sqlalchemy.engines [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:44 devstack cinder-volume[85741]: INFO cinder.volume.manager [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Determined volume DB was empty at startup. Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG cinder.volume.manager [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85741) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 17:45:44 devstack cinder-volume[85741]: INFO cinder.volume.manager [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 17:45:44 devstack cinder-volume[85741]: WARNING stevedore.named [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 17:45:44 devstack cinder-volume[85741]: WARNING castellan.key_manager [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:45:44 devstack cinder-volume[85741]: WARNING cinder.keymgr.conf_key_mgr [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:45:44 devstack cinder-volume[85741]: INFO cinder.volume.manager [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_db.sqlalchemy.engines [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85741) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:44 devstack cinder-volume[85741]: INFO oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Starting 1 workers Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Started child 85958 {{(pid=85741) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Full set of CONF: {{(pid=85741) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] ******************************************************************************** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Configuration options gathered from: {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] ================================================================================ {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] allow_availability_zone_fallback = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] allow_compression_on_image_upload = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] allowed_direct_url_schemes = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] api_rate_limit = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] auth_strategy = keystone {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_availability_zone = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_host = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85958]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_stats_polling_interval = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backup_api_class = cinder.backup.api.API {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backup_name_template = backup-%s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backup_use_same_host = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backup_use_temp_snapshot = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] chap_password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] chap_username = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_internal_tenant_project_id = 86e513e7b4f64869b3eff39898e2aa48 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_internal_tenant_user_id = 154331a236824871809bce1a91288d87 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cluster = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] compression_format = gzip {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] compute_api_class = cinder.compute.nova.API {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] config_dir = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] config_source = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] control_exchange = openstack {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] debug = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] default_availability_zone = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] default_group_type = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] default_volume_type = QuobyteHD {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] disk_geometry = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] driver_client_cert = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] driver_client_cert_key = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] driver_data_namespace = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] driver_ssl_cert_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] driver_ssl_cert_verify = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] driver_use_ssl = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] enable_new_services = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] enable_unsupported_driver = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] enabled_backends = ['QuobyteHD'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] enforce_multipath_for_image_xfer = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] filter_function = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_api_insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_api_ssl_compression = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_ca_certificates_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_catalog_info = image:glance:publicURL {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_num_retries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance_request_timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] goodness_function = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] graceful_shutdown_timeout = 5 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] group_api_class = cinder.group.api.API {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] host = devstack {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_compress_on_upload = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_conversion_address_space_limit = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_conversion_cpu_limit = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_conversion_disable = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_introspection_address_space_limit = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_introspection_cpu_limit = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_upload_use_cinder_backend = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85958]: INFO cinder.volume.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_upload_use_internal_tenant = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_volume_cache_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_volume_cache_max_count = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] image_volume_cache_max_size_gb = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] init_host_max_objects_retrieval = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] instance_format = [instance: %(uuid)s] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] iscsi_target_flags = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] iscsi_write_cache = on {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] iser_helper = tgtadm {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] iser_ip_address = 192.168.122.213 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] iser_port = 3260 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_color = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.remotefs [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85958) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_config_append = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_dir = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_options = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_rotate_interval = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_rotate_interval_type = days {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] log_rotation_type = none {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] max_age = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] max_logfile_count = 30 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] max_logfile_size_mb = 200 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] max_over_subscription_ratio = 20.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] message_reap_interval = 86400 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] message_ttl = 2592000 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] migration_create_volume_timeout_secs = 300 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] monkey_patch = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] monkey_patch_modules = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] my_ip = 192.168.122.213 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] no_snapshot_gb_quota = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] num_iser_scan_tries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] num_shell_tries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] num_volume_device_scan_tries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] nvmeof_conn_info_version = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] nvmet_ns_id = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] nvmet_port_id = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_max_limit = 1000 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_volume_ext_list = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_volume_listen_port = 8776 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_volume_use_ssl = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] osapi_volume_workers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] per_volume_size_limit = -1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] periodic_fuzzy_delay = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] periodic_interval = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] public_endpoint = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] publish_errors = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_backup_gigabytes = 1000 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_backups = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_gigabytes = 1000 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_groups = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_snapshots = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] quota_volumes = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] rate_limit_burst = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] rate_limit_except_level = CRITICAL {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] rate_limit_interval = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] reinit_driver_count = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] replication_device = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] report_discard_supported = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] report_interval = 120 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] reservation_clean_interval = 86400 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] reservation_expire = 86400 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] reserved_image_namespaces = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] reserved_percentage = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] rpc_response_timeout = 120 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] run_external_periodic_tasks = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] scst_target_driver = iscsi {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] scst_target_iqn_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_down_time = 720 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] shell_completion = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] snapshot_name_template = snapshot-%s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] split_loggers = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] state_path = /opt/stack/data/cinder {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] storage_availability_zone = nova {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] storage_protocol = iSCSI {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] syslog_log_facility = LOG_USER {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] target_helper = lioadm {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] target_ip_address = 192.168.122.213 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] target_port = 3260 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] target_protocol = iscsi {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] target_secondary_ip_addresses = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] trace_flags = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] transport_url = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] until_refresh = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_chap_auth = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_default_quota_class = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_journal = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_json = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_multipath_for_image_xfer = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_stderr = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] use_syslog = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] verify_glance_signatures = enabled {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_api_class = cinder.volume.api.API {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_backend_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_clear = zero {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_clear_ionice = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_clear_size = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_copy_bps_limit = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_dd_blocksize = 1M {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_name_template = volume-%s {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_service_inithost_offload = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volume_usage_audit_period = month {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] zoning_mode = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_concurrency.disable_process_locking = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85958) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 17:45:44 devstack cinder-volume[85958]: WARNING cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 17:45:44 devstack cinder-volume[85958]: WARNING cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Running cmd (subprocess): mount.quobyte {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.auth_section = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.auth_type = password {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.auth_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.cache = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.include_service_catalog = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.interface = public {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcache_username = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.region_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.service_type = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:44 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.backend = dogpile.cache.null {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.backend_argument = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.backend_expiration_time = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.config_prefix = cache.oslo {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.debug_cache_backend = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.enable_retry_client = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.enable_socket_keepalive = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.expiration_time = 600 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.hashclient_retry_attempts = 2 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_dead_retry = 300 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_pool_maxsize = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_sasl_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.proxies = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.redis_db = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.redis_server = localhost:6379 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.retry_attempts = 2 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.retry_delay = 0.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.socket_keepalive_count = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.socket_keepalive_idle = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.socket_keepalive_interval = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.socket_timeout = 1.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.tls_allowed_ciphers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.tls_cafile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.tls_certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.tls_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.tls_keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cache.username = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] coordination.backend_url = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.asyncio_connection = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.asyncio_slave_connection = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.backend = sqlalchemy {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.connection = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.connection_debug = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.connection_parameters = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.connection_recycle_time = 3600 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.connection_trace = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.db_inc_retry_interval = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.db_max_retries = 20 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.db_max_retry_interval = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.db_retry_interval = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.max_overflow = 50 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.max_pool_size = 5 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.max_retries = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.mysql_wsrep_sync_wait = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.pool_timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.retry_interval = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.slave_connection = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack quobyte-client[85961]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 17:45:45 devstack quobyte-client[85961]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.sqlite_synchronous = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.synchronous_reader = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] database.use_db_reconnect = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=85958) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85958]: INFO cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 ... Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 -c /etc/quobyte/client-cinder.cfg {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_tracing.insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.connection_string = messaging:// {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.es_doc_type = notification {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.es_scroll_size = 10000 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.es_scroll_time = 2m {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.filter_error_trace = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.hmac_keys = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.sentinel_service_name = mymaster {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.socket_timeout = 0.1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.trace_requests = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler.trace_sqlalchemy = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler_jaeger.process_tags = {} {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler_jaeger.service_name_prefix = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] profiler_otlp.service_name_prefix = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.enforce_new_defaults = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.policy_default_rule = default {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.policy_file = policy.yaml {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.group = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.helper_command = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] privsep_osbrick.user = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.group = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.helper_command = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 -c /etc/quobyte/client-cinder.cfg Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] cinder_sys_admin.user = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.auth_section = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.auth_type = password {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.cafile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.collect_timing = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.send_service_user_token = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.split_loggers = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.tls_ciphers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] service_user.tls_min_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.auth_section = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.auth_type = password {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.collect_timing = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.region_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.split_loggers = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.tls_ciphers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] glance.tls_min_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.backend_availability_zone = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.chap_password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.chap_username = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.disk_geometry = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.driver_client_cert = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.driver_client_cert_key = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.driver_data_namespace = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.driver_use_ssl = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.extra_capabilities = {} {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.filter_function = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.goodness_function = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.iscsi_target_flags = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.iscsi_write_cache = on {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.iser_helper = tgtadm {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.iser_port = 3260 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_host = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_login = admin {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_mount_options = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_private_key = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_share_path = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.num_shell_tries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.quobyte_volume_url = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.replication_device = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.report_discard_supported = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.reserved_percentage = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.target_helper = tgtadm {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.target_port = 3260 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.target_protocol = iscsi {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.trace_flags = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.unique_fqdn_network = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.use_chap_auth = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_backend_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_clear = zero {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_clear_ionice = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_clear_size = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_reports.file_event_handler = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_reports.log_dir = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.backend_availability_zone = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.backend_host = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.chap_password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.chap_username = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.chiscsi_conf = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.disk_geometry = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.driver_client_cert = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.driver_data_namespace = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.driver_use_ssl = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.extra_capabilities = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.filter_function = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.goodness_function = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.iser_helper = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.iser_ip_address = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.iser_port = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.iser_target_prefix = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_host = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_login = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_mount_options = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_password = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_private_key = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_share_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_ssh_port = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.num_shell_tries = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.nvmet_port_id = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.replication_device = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.report_discard_supported = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.reserved_percentage = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.scst_target_driver = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.storage_protocol = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.target_helper = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.target_ip_address = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.target_port = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.target_prefix = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.target_protocol = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.trace_flags = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.use_chap_auth = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_clear = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_clear_size = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] QuobyteHD.volumes_dir = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_notifications.driver = [] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_notifications.retry = -1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] key_manager.fixed_key = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.barbican_api_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.barbican_endpoint = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.barbican_endpoint_type = public {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.barbican_region_name = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.cafile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.collect_timing = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.number_of_retries = 60 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.retry_delay = 1 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.send_service_user_token = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.split_loggers = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.tls_ciphers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.tls_min_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.verify_ssl = True {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican.verify_ssl_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.auth_section = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.auth_type = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.cafile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.certfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.collect_timing = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.insecure = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.keyfile = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.split_loggers = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.timeout = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.tls_ciphers = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] barbican_service_user.tls_min_version = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.approle_role_id = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.approle_secret_id = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.auth_method = approle {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.auth_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.kv_mountpoint = secret {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.kv_path = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.kv_version = 2 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.namespace = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.root_token_id = **** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.ssl_ca_crt_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.timeout = 60.0 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.token_file = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.token_role = None {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.use_ssl = False {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:45 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] ******************************************************************************** {{(pid=85741) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 17:45:45 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.457s {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:45 devstack cinder-volume[85958]: INFO cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 succeeded Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=85958) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.471s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:45 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:45:45 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:45 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.244s {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:45 devstack cinder-volume[85958]: INFO cinder.volume.driver [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Driver hasn't implemented _init_vendor_properties() Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.volume.driver [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7889251708984, 'free_capacity_gb': 1773.7889251708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85958) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_db.sqlalchemy.engines [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85958) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG dbcounter [-] [85958] Writer thread running {{(pid=85958) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.db.api [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Building query based on filter {{(pid=85958) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.image.image_utils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85958) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 17:45:45 devstack cinder-volume[85958]: INFO cinder.keymgr.migration [None req-1fd8f7a5-e933-4523-99fa-85147d07975b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=85958) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=85958) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:45:45 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:45 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:45:45 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:46 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.241s {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG cinder.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Notifying Schedulers of capabilities ... {{(pid=85958) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:45:46 devstack cinder-volume[85958]: INFO cinder.volume.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Driver initialization completed successfully. Nov 02 17:45:46 devstack cinder-volume[85958]: INFO cinder.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Initiating service 3 cleanup Nov 02 17:45:46 devstack cinder-volume[85958]: INFO cinder.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Service 3 cleanup completed. Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG cinder.service [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Creating RPC server for service cinder-volume {{(pid=85958) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG cinder.service [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85958) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 17:45:46 devstack cinder-volume[85958]: INFO cinder.volume.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=85958) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=85958) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:46 devstack sudo[86099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:45:46 devstack sudo[86099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:46 devstack sudo[86099]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:46 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.288s {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:46 devstack cinder-volume[85958]: INFO cinder.volume.manager [None req-7d19241e-16fb-465c-b4b3-656b8067d1ed None None] Driver post RPC initialization completed successfully. Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=85958) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=85958) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85958) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:50 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:45:50 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:50 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG oslo_concurrency.processutils [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.230s {{(pid=85958) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:50 devstack cinder-volume[85958]: DEBUG cinder.manager [None req-c9b1508c-785d-44b4-bd0c-a3ea3e8fd796 None None] Notifying Schedulers of capabilities ... {{(pid=85958) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:45:51 devstack cinder-volume[85741]: INFO oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Caught SIGTERM, stopping children Nov 02 17:45:51 devstack cinder-volume[85741]: DEBUG oslo_concurrency.lockutils [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Acquiring lock "singleton_lock" {{(pid=85741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:45:51 devstack cinder-volume[85741]: DEBUG oslo_concurrency.lockutils [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Acquired lock "singleton_lock" {{(pid=85741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:45:51 devstack cinder-volume[85741]: DEBUG oslo_concurrency.lockutils [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Releasing lock "singleton_lock" {{(pid=85741) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:45:51 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Stop services. {{(pid=85741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 17:45:51 devstack cinder-volume[85741]: DEBUG oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Killing children. {{(pid=85741) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 17:45:51 devstack cinder-volume[85741]: INFO oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Waiting on 1 children to exit Nov 02 17:45:54 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Acquiring lock "singleton_lock" {{(pid=85958) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:45:54 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Acquired lock "singleton_lock" {{(pid=85958) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:45:54 devstack cinder-volume[85958]: DEBUG oslo_concurrency.lockutils [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Releasing lock "singleton_lock" {{(pid=85958) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:45:54 devstack cinder-volume[85958]: WARNING amqp [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 17:45:54 devstack cinder-volume[85958]: WARNING amqp [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 17:45:54 devstack cinder-volume[85741]: INFO oslo_service.backend._eventlet.service [None req-1b92deef-5b19-4ca5-b963-fef449ee1b36 None None] Child 85958 exited with status 0 Nov 02 17:45:55 devstack cinder-volume[86281]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 17:45:55 devstack cinder-volume[86281]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 17:45:55 devstack cinder-volume[86281]: we strongly recommend against using it for new projects. Nov 02 17:45:55 devstack cinder-volume[86281]: If you are already using Eventlet, we recommend migrating to a different Nov 02 17:45:55 devstack cinder-volume[86281]: framework. For more detail see Nov 02 17:45:55 devstack cinder-volume[86281]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 17:45:55 devstack cinder-volume[86281]: import eventlet # noqa Nov 02 17:45:57 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 17:45:57 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 17:45:57 devstack cinder-volume[86281]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86281) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 17:45:58 devstack cinder-volume[86281]: INFO dbcounter [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Registered counter for database cinder Nov 02 17:45:58 devstack cinder-volume[86281]: DEBUG oslo_db.sqlalchemy.engines [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86281) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG dbcounter [-] [86281] Writer thread running {{(pid=86281) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 17:45:59 devstack cinder-volume[86281]: INFO cinder.rpc [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 17:45:59 devstack cinder-volume[86281]: INFO cinder.rpc [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_db.sqlalchemy.engines [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86281) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:59 devstack cinder-volume[86281]: INFO cinder.volume.manager [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Determined volume DB was empty at startup. Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG cinder.volume.manager [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86281) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 17:45:59 devstack cinder-volume[86281]: WARNING stevedore.named [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 17:45:59 devstack cinder-volume[86281]: WARNING castellan.key_manager [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:45:59 devstack cinder-volume[86281]: WARNING cinder.keymgr.conf_key_mgr [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 17:45:59 devstack cinder-volume[86281]: INFO cinder.volume.manager [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_db.sqlalchemy.engines [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86281) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:59 devstack cinder-volume[86281]: INFO oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Starting 1 workers Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Started child 86585 {{(pid=86281) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Full set of CONF: {{(pid=86281) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] ******************************************************************************** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] Configuration options gathered from: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] ================================================================================ {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] allow_availability_zone_fallback = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] allow_compression_on_image_upload = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] allowed_direct_url_schemes = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] api_rate_limit = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] auth_strategy = keystone {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_host = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86585]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_stats_polling_interval = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backup_api_class = cinder.backup.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backup_name_template = backup-%s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backup_use_same_host = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backup_use_temp_snapshot = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] chap_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] chap_username = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_internal_tenant_project_id = 86e513e7b4f64869b3eff39898e2aa48 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_internal_tenant_user_id = 154331a236824871809bce1a91288d87 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cluster = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] compression_format = gzip {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] compute_api_class = cinder.compute.nova.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] config_dir = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] config_source = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] control_exchange = openstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] debug = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] default_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] default_group_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] default_volume_type = QuobyteHD {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] disk_geometry = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] driver_client_cert = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] driver_client_cert_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] driver_data_namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] driver_ssl_cert_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] driver_ssl_cert_verify = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] driver_use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] enable_new_services = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] enable_unsupported_driver = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] enabled_backends = ['QuobyteHD'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] enforce_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] filter_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_api_insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_api_ssl_compression = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_ca_certificates_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_catalog_info = image:glance:publicURL {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_num_retries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance_request_timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] goodness_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] graceful_shutdown_timeout = 5 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] group_api_class = cinder.group.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] host = devstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_compress_on_upload = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_conversion_address_space_limit = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_conversion_cpu_limit = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_conversion_disable = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_introspection_address_space_limit = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_introspection_cpu_limit = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_upload_use_cinder_backend = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_upload_use_internal_tenant = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_volume_cache_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_volume_cache_max_count = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] image_volume_cache_max_size_gb = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] init_host_max_objects_retrieval = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] instance_format = [instance: %(uuid)s] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] iscsi_target_flags = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] iscsi_write_cache = on {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] iser_helper = tgtadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] iser_ip_address = 192.168.122.213 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] iser_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_color = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_config_append = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_dir = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_options = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_rotate_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_rotate_interval_type = days {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] log_rotation_type = none {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] max_age = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] max_logfile_count = 30 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] max_logfile_size_mb = 200 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] max_over_subscription_ratio = 20.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] message_reap_interval = 86400 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] message_ttl = 2592000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] migration_create_volume_timeout_secs = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] monkey_patch = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] monkey_patch_modules = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] my_ip = 192.168.122.213 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] no_snapshot_gb_quota = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86585) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] num_iser_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] num_shell_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] num_volume_device_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] nvmeof_conn_info_version = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] nvmet_ns_id = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] nvmet_port_id = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_max_limit = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_volume_ext_list = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_volume_listen_port = 8776 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_volume_use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] osapi_volume_workers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] per_volume_size_limit = -1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] periodic_fuzzy_delay = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] periodic_interval = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] public_endpoint = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] publish_errors = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_backup_gigabytes = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_backups = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_gigabytes = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_groups = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_snapshots = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] quota_volumes = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] rate_limit_burst = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] rate_limit_except_level = CRITICAL {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] rate_limit_interval = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] reinit_driver_count = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] replication_device = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] report_discard_supported = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] report_interval = 120 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] reservation_clean_interval = 86400 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] reservation_expire = 86400 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] reserved_image_namespaces = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] reserved_percentage = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] rpc_response_timeout = 120 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] run_external_periodic_tasks = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] scst_target_driver = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] scst_target_iqn_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_down_time = 720 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] shell_completion = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] snapshot_name_template = snapshot-%s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] state_path = /opt/stack/data/cinder {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] storage_availability_zone = nova {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] storage_protocol = iSCSI {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] syslog_log_facility = LOG_USER {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] target_helper = lioadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] target_ip_address = 192.168.122.213 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] target_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] target_protocol = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] target_secondary_ip_addresses = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] trace_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] transport_url = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] until_refresh = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_chap_auth = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_default_quota_class = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_journal = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_json = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_stderr = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] use_syslog = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] verify_glance_signatures = enabled {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_api_class = cinder.volume.api.API {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_backend_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_clear = zero {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_clear_ionice = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_clear_size = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_copy_bps_limit = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_dd_blocksize = 1M {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_name_template = volume-%s {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_service_inithost_offload = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volume_usage_audit_period = month {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] zoning_mode = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_concurrency.disable_process_locking = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.auth_type = password {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.auth_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.cache = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.include_service_catalog = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.interface = public {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcache_username = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.region_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.service_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.backend = dogpile.cache.null {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.backend_argument = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.backend_expiration_time = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.config_prefix = cache.oslo {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.debug_cache_backend = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.enable_retry_client = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.enable_socket_keepalive = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.expiration_time = 600 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86585) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.hashclient_retry_attempts = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_dead_retry = 300 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_pool_maxsize = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_sasl_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Running cmd (subprocess): mount.quobyte {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.proxies = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.redis_db = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.redis_server = localhost:6379 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.retry_attempts = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.retry_delay = 0.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.socket_keepalive_count = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.socket_keepalive_idle = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.socket_keepalive_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.socket_timeout = 1.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.tls_allowed_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.tls_cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.tls_certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.tls_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.tls_keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cache.username = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] coordination.backend_url = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.asyncio_connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.asyncio_slave_connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.backend = sqlalchemy {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.connection_debug = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.connection_parameters = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.connection_recycle_time = 3600 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.connection_trace = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.db_inc_retry_interval = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.db_max_retries = 20 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.db_max_retry_interval = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.db_retry_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.max_overflow = 50 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.max_pool_size = 5 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.max_retries = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.mysql_wsrep_sync_wait = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.pool_timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.retry_interval = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.slave_connection = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.sqlite_synchronous = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.synchronous_reader = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] database.use_db_reconnect = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_tracing.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.connection_string = messaging:// {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.es_doc_type = notification {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.es_scroll_size = 10000 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.es_scroll_time = 2m {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.filter_error_trace = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.hmac_keys = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.sentinel_service_name = mymaster {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.socket_timeout = 0.1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.trace_requests = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler.trace_sqlalchemy = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler_jaeger.process_tags = {} {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler_jaeger.service_name_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] profiler_otlp.service_name_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.enforce_new_defaults = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.policy_default_rule = default {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.policy_file = policy.yaml {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.group = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.helper_command = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] privsep_osbrick.user = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.group = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.helper_command = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] cinder_sys_admin.user = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.auth_type = password {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.send_service_user_token = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.tls_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] service_user.tls_min_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.auth_type = password {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.region_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.tls_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] glance.tls_min_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.backend_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.chap_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.chap_username = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.disk_geometry = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.driver_client_cert = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.driver_client_cert_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.driver_data_namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.driver_use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.extra_capabilities = {} {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.filter_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.goodness_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.iscsi_target_flags = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.iscsi_write_cache = on {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.iser_helper = tgtadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.iser_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_host = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_login = admin {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_mount_options = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_private_key = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack quobyte-client[86586]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 17:45:59 devstack quobyte-client[86586]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_share_path = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.num_shell_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.quobyte_volume_url = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.replication_device = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.report_discard_supported = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.reserved_percentage = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.target_helper = tgtadm {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.target_port = 3260 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.target_protocol = iscsi {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.trace_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.unique_fqdn_network = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.use_chap_auth = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_backend_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_clear = zero {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_clear_ionice = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_clear_size = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_reports.file_event_handler = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_reports.log_dir = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.backend_availability_zone = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.backend_host = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.chap_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.chap_username = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.chiscsi_conf = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.disk_geometry = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.driver_client_cert = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.driver_data_namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.driver_use_ssl = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.extra_capabilities = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.filter_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.goodness_function = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.iser_helper = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.iser_ip_address = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.iser_port = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.iser_target_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_host = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_login = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_mount_options = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_password = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_private_key = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_share_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_ssh_port = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.num_shell_tries = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.nvmet_port_id = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.replication_device = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.report_discard_supported = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.reserved_percentage = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.scst_target_driver = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.storage_protocol = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.target_helper = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.target_ip_address = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.target_port = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.target_prefix = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.target_protocol = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.trace_flags = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.use_chap_auth = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_clear = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_clear_size = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] QuobyteHD.volumes_dir = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_notifications.driver = [] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_notifications.retry = -1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] key_manager.fixed_key = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.barbican_api_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.barbican_endpoint = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.barbican_endpoint_type = public {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.barbican_region_name = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.number_of_retries = 60 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.retry_delay = 1 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.send_service_user_token = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.tls_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.tls_min_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.verify_ssl = True {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican.verify_ssl_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.auth_section = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.auth_type = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.cafile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.certfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.collect_timing = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.insecure = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.keyfile = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.split_loggers = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.timeout = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.tls_ciphers = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] barbican_service_user.tls_min_version = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.approle_role_id = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.approle_secret_id = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.auth_method = approle {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.auth_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.kv_mountpoint = secret {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.kv_path = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.kv_version = 2 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.namespace = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.root_token_id = **** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.ssl_ca_crt_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.timeout = 60.0 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.token_file = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.token_role = None {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.use_ssl = False {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 17:45:59 devstack cinder-volume[86281]: DEBUG oslo_service.backend._eventlet.service [None req-5bdf8e21-954b-4673-993c-f7d1bc333468 None None] ******************************************************************************** {{(pid=86281) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 17:45:59 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:45:59 devstack cinder-volume[86585]: INFO cinder.volume.driver [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Driver hasn't implemented _init_vendor_properties() Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.driver [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7889251708984, 'free_capacity_gb': 1773.7889251708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86585) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_db.sqlalchemy.engines [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writer thread running {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.db.api [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Building query based on filter {{(pid=86585) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86585) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:45:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:45:59 devstack cinder-volume[86585]: INFO cinder.keymgr.migration [None req-ae0e947a-7b43-44f3-9a51-af9ea3af53d7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 17:45:59 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:45:59 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:46:00 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.246s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:46:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Driver initialization completed successfully. Nov 02 17:46:00 devstack cinder-volume[86585]: INFO cinder.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Initiating service 3 cleanup Nov 02 17:46:00 devstack cinder-volume[86585]: INFO cinder.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Service 3 cleanup completed. Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG cinder.service [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Creating RPC server for service cinder-volume {{(pid=86585) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG cinder.service [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86585) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 17:46:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:46:00 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:46:00 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:46:00 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Nov 02 17:46:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:46:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-27f0b37c-f280-45b0-80f9-57a9299781d8 None None] Driver post RPC initialization completed successfully. Nov 02 17:46:09 devstack cinder-volume[86281]: DEBUG dbcounter [-] [86281] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86281) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:46:10 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:46:10 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:46:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:46:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 6 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:46:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Flow 'volume_create_manager' (724b7904-c9e3-4bcb-95e3-e9a4ae8d5cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0133ac-0f87-4015-93c6-42e5ce0d3c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0133ac-0f87-4015-93c6-42e5ce0d3c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-601442012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0968f44d-f44c-435b-9380-5e07e5224e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa0551942ef4fd999007442e885a344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:47:06Z,use_quota=True,user_id='f4e0d8e6aea94ec58876fe4e94c479a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7da72f7-b262-41f3-9913-20dc6a0e6502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7da72f7-b262-41f3-9913-20dc6a0e6502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9286edfe-4ad3-43a0-9d59-64ea122d9a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9286edfe-4ad3-43a0-9d59-64ea122d9a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0968f44d-f44c-435b-9380-5e07e5224e18', 'volume_name': 'volume-0968f44d-f44c-435b-9380-5e07e5224e18', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425e2d76-1796-4c3a-80d6-9735653faaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425e2d76-1796-4c3a-80d6-9735653faaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2406ca-b314-4f21-9654-fd8eb6fd7cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Volume 0968f44d-f44c-435b-9380-5e07e5224e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0968f44d-f44c-435b-9380-5e07e5224e18', 'volume_size': 1} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-601442012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0968f44d-f44c-435b-9380-5e07e5224e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fa0551942ef4fd999007442e885a344',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:47:06Z,use_quota=True,user_id='f4e0d8e6aea94ec58876fe4e94c479a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Creating volume 0968f44d-f44c-435b-9380-5e07e5224e18 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:47:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:47:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:06 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 1073741824 Nov 02 17:47:06 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:07 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 1073741824" returned: 0 in 0.873s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:07 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 Nov 02 17:47:07 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:07 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18" returned: 0 in 0.544s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:47:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2406ca-b314-4f21-9654-fd8eb6fd7cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0968f44d-f44c-435b-9380-5e07e5224e18', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6644fb-2c5e-4193-8822-84d33c148fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Volume volume-0968f44d-f44c-435b-9380-5e07e5224e18 (0968f44d-f44c-435b-9380-5e07e5224e18): created successfully Nov 02 17:47:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6644fb-2c5e-4193-8822-84d33c148fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Flow 'volume_create_manager' (724b7904-c9e3-4bcb-95e3-e9a4ae8d5cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:47:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5002468f-abde-4fc4-a997-75cbdd93b9e4 tempest-DeleteServersTestJSON-777435164 None] Created volume successfully. Nov 02 17:47:15 devstack cinder-volume[86585]: WARNING py.warnings [req-747dae3c-e34a-4494-8c71-ee27036d4c18 req-488d3451-b3d3-4a8a-8345-da6a503d5a54 tempest-DeleteServersTestJSON-777435164 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 02 17:47:15 devstack cinder-volume[86585]: .first() Nov 02 17:47:15 devstack cinder-volume[86585]: Nov 02 17:47:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-747dae3c-e34a-4494-8c71-ee27036d4c18 req-488d3451-b3d3-4a8a-8345-da6a503d5a54 tempest-DeleteServersTestJSON-777435164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-747dae3c-e34a-4494-8c71-ee27036d4c18 req-488d3451-b3d3-4a8a-8345-da6a503d5a54 tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-747dae3c-e34a-4494-8c71-ee27036d4c18 req-488d3451-b3d3-4a8a-8345-da6a503d5a54 tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-747dae3c-e34a-4494-8c71-ee27036d4c18 req-488d3451-b3d3-4a8a-8345-da6a503d5a54 tempest-DeleteServersTestJSON-777435164 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-0968f44d-f44c-435b-9380-5e07e5224e18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '297fd400-420f-468c-ac32-8f98f83012a1', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:47:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-747dae3c-e34a-4494-8c71-ee27036d4c18 req-488d3451-b3d3-4a8a-8345-da6a503d5a54 tempest-DeleteServersTestJSON-777435164 None] attachment_update completed successfully. Nov 02 17:47:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-88286147-ce3e-435f-8e18-1f1b0dac3fae req-56282a5b-ce3a-4dfe-8669-ce9266fc41a9 tempest-DeleteServersTestJSON-777435164 None] Terminate volume connection completed successfully. Nov 02 17:47:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-88286147-ce3e-435f-8e18-1f1b0dac3fae req-56282a5b-ce3a-4dfe-8669-ce9266fc41a9 tempest-DeleteServersTestJSON-777435164 None] Deleting attachment 297fd400-420f-468c-ac32-8f98f83012a1. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:47:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Acquiring lock "cinder-0968f44d-f44c-435b-9380-5e07e5224e18-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:47:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Lock "cinder-0968f44d-f44c-435b-9380-5e07e5224e18-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:47:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Acquiring lock "cinder-quobyte-0968f44d-f44c-435b-9380-5e07e5224e18" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:47:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Lock "cinder-quobyte-0968f44d-f44c-435b-9380-5e07e5224e18" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:47:23 devstack cinder-volume[86585]: INFO oslo.privsep.daemon [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm6ndk5yv/privsep.sock'] Nov 02 17:47:24 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm6ndk5yv/privsep.sock Nov 02 17:47:24 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 17:47:25 devstack cinder-volume[86585]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 17:47:25 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:25 devstack cinder-volume[86585]: INFO oslo.privsep.daemon [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Spawned new privsep daemon via rootwrap Nov 02 17:47:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Accepted privsep connection to /tmp/tmpm6ndk5yv/privsep.sock {{(pid=86585) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 17:47:25 devstack cinder-volume[86585]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 17:47:25 devstack cinder-volume[86585]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 17:47:25 devstack cinder-volume[86585]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 17:47:25 devstack cinder-volume[86585]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88274 Nov 02 17:47:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0261f-7329-473b-8d00-1560876f872f]: (2,) {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:47:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee1882-db6a-435c-a8f4-63d34284d0b6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:47:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:25 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 Nov 02 17:47:25 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:26 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18" returned: 0 in 0.633s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:26 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18 Nov 02 17:47:26 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:26 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0968f44d-f44c-435b-9380-5e07e5224e18" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Lock "cinder-quobyte-0968f44d-f44c-435b-9380-5e07e5224e18" released by "delete_volume" :: held 2.450s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:47:26 devstack cinder-volume[86585]: WARNING cinder.quota [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:47:26 devstack cinder-volume[86585]: WARNING cinder.quota [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Created reservations ['a06efdf0-1762-4c49-bcbe-c477a0f1dd48', '02d9a781-9eae-4b40-ace4-9fc0ec17b90a', '6ec166aa-ef90-4a3f-8177-03660b71f11f', 'bb2c9ef7-ac8b-4911-a5fd-d301700dbe6c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:26 devstack sudo[88315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:47:26 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:27 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.372s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:27 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:47:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Deleted volume successfully. Nov 02 17:47:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a18d6d57-1b65-467b-aff8-52af68c27b1a tempest-DeleteServersTestJSON-777435164 None] Lock "cinder-0968f44d-f44c-435b-9380-5e07e5224e18-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Flow 'volume_create_manager' (b8af5f9b-f00f-4f71-9346-fc8dc83fe72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9236918b-ec27-46f3-afc4-bfaf2b0e11a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9236918b-ec27-46f3-afc4-bfaf2b0e11a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1937770499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec804fa1-95e4-46f5-8925-f9b5bde0d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022351da2994475dab71c2c60a1d4cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:47:28Z,use_quota=True,user_id='84d8e68d4e1d4800acb0495c678955f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e0a7ee-eb6a-47a8-9209-71204ecaed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e0a7ee-eb6a-47a8-9209-71204ecaed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42014d1-4cd5-4665-981e-f175fb396338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42014d1-4cd5-4665-981e-f175fb396338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec804fa1-95e4-46f5-8925-f9b5bde0d51e', 'volume_name': 'volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02de6d7a-b6dc-444d-a7e4-9fe069b9453e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02de6d7a-b6dc-444d-a7e4-9fe069b9453e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd03a34-e3a4-4733-9281-c9ba5079f8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Volume ec804fa1-95e4-46f5-8925-f9b5bde0d51e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e', 'volume_size': 1} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:47:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1937770499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec804fa1-95e4-46f5-8925-f9b5bde0d51e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022351da2994475dab71c2c60a1d4cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:47:28Z,use_quota=True,user_id='84d8e68d4e1d4800acb0495c678955f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Creating volume ec804fa1-95e4-46f5-8925-f9b5bde0d51e {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:47:28 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:28 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e 1073741824 Nov 02 17:47:28 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:28 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e 1073741824" returned: 0 in 0.631s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:28 devstack sudo[88325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e Nov 02 17:47:28 devstack sudo[88325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:29 devstack sudo[88325]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e" returned: 0 in 0.282s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd03a34-e3a4-4733-9281-c9ba5079f8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2d00f6-e430-4eaf-897b-23bd725cb788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Volume volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e (ec804fa1-95e4-46f5-8925-f9b5bde0d51e): created successfully Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b2d00f6-e430-4eaf-897b-23bd725cb788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Flow 'volume_create_manager' (b8af5f9b-f00f-4f71-9346-fc8dc83fe72d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:47:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e632f2fa-61d7-4fdd-8732-64743802b90b tempest-VolumesAdminNegativeTest-1458527151 None] Created volume successfully. Nov 02 17:47:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Acquiring lock "cinder-ec804fa1-95e4-46f5-8925-f9b5bde0d51e-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:47:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Lock "cinder-ec804fa1-95e4-46f5-8925-f9b5bde0d51e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:47:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Acquiring lock "cinder-quobyte-ec804fa1-95e4-46f5-8925-f9b5bde0d51e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:47:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Lock "cinder-quobyte-ec804fa1-95e4-46f5-8925-f9b5bde0d51e" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:47:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd21e7-8eb5-4cfb-8926-4b661fe064d4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:47:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:31 devstack sudo[88329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e Nov 02 17:47:31 devstack sudo[88329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:31 devstack sudo[88329]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e" returned: 0 in 0.558s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:31 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e Nov 02 17:47:31 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:31 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec804fa1-95e4-46f5-8925-f9b5bde0d51e" returned: 0 in 0.262s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Lock "cinder-quobyte-ec804fa1-95e4-46f5-8925-f9b5bde0d51e" released by "delete_volume" :: held 0.899s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:47:31 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Created reservations ['fed3ccc5-908c-4478-b9c1-915eb5f2c694', 'e7fc39dc-91c9-4a5d-8aa6-7bd72e795b3b', '33dc5170-4067-4f26-95d6-a01da99a878a', '85218aef-7186-4269-ace2-093730c62d2a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:32 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:47:32 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:32 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.360s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:47:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Deleted volume successfully. Nov 02 17:47:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7041ebed-0ae0-4d32-aeb5-99ca57097020 tempest-VolumesAdminNegativeTest-1458527151 None] Lock "cinder-ec804fa1-95e4-46f5-8925-f9b5bde0d51e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Flow 'volume_create_manager' (fe0f92bd-0bec-41fa-a61f-28e9d74a8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ba1ecf-18ef-4f2d-b9b6-429e06679e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8ba1ecf-18ef-4f2d-b9b6-429e06679e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1563094670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93985a2d-376e-4f8e-8853-0c606b361310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d066f25972ac446aa51f17b3183558a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:47:40Z,use_quota=True,user_id='9dbf6ba01dac4509a83b60f5153f38d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ed47bd-e5b6-499c-9dbd-704b608bd42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ed47bd-e5b6-499c-9dbd-704b608bd42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb99d97-db7d-4ed2-a5c8-6142c35829c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb99d97-db7d-4ed2-a5c8-6142c35829c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93985a2d-376e-4f8e-8853-0c606b361310', 'volume_name': 'volume-93985a2d-376e-4f8e-8853-0c606b361310', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727e7098-d760-4b07-961f-7237e88ea7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727e7098-d760-4b07-961f-7237e88ea7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04e2abf-f1b8-4676-9edb-458c37d0563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Volume 93985a2d-376e-4f8e-8853-0c606b361310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93985a2d-376e-4f8e-8853-0c606b361310', 'volume_size': 1} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1563094670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93985a2d-376e-4f8e-8853-0c606b361310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d066f25972ac446aa51f17b3183558a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:47:40Z,use_quota=True,user_id='9dbf6ba01dac4509a83b60f5153f38d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Creating volume 93985a2d-376e-4f8e-8853-0c606b361310 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:47:40 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:47:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:40 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 1073741824 Nov 02 17:47:40 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:41 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 1073741824" returned: 0 in 0.484s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:41 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 Nov 02 17:47:41 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:41 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310" returned: 0 in 0.274s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04e2abf-f1b8-4676-9edb-458c37d0563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93985a2d-376e-4f8e-8853-0c606b361310', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119911b3-8ac5-4c73-97c4-139f5bc07a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:47:41 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Volume volume-93985a2d-376e-4f8e-8853-0c606b361310 (93985a2d-376e-4f8e-8853-0c606b361310): created successfully Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (119911b3-8ac5-4c73-97c4-139f5bc07a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:47:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Flow 'volume_create_manager' (fe0f92bd-0bec-41fa-a61f-28e9d74a8bed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:47:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f9093ee2-aed7-48e3-a029-b66609889efe tempest-AttachVolumeShelveTestJSON-1388258993 None] Created volume successfully. Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:47:46 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:47:46 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:47:46 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 8 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:47:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:47:51 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:47:51 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Flow 'volume_create_manager' (4e921337-9702-478c-8802-e4b061c28e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f3b91c-fd55-45d6-a26c-2c31295298a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f3b91c-fd55-45d6-a26c-2c31295298a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1442329881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4556c8d-43bb-4e2e-8460-977770de554f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d6cec0a5a64fa3ab5eb6cfb643b1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:06Z,use_quota=True,user_id='3396d2c4373c465ab3f3f87bfe5833c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783e8e60-b167-43ba-a495-733f3d9eb6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783e8e60-b167-43ba-a495-733f3d9eb6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1875de1f-e191-4204-84df-3c7d4fbca6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1875de1f-e191-4204-84df-3c7d4fbca6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4556c8d-43bb-4e2e-8460-977770de554f', 'volume_name': 'volume-b4556c8d-43bb-4e2e-8460-977770de554f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24103ce4-9040-4952-8335-55f73c0833a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24103ce4-9040-4952-8335-55f73c0833a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fedec0c-092d-44ac-9fd9-6d722e9a71ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Volume b4556c8d-43bb-4e2e-8460-977770de554f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4556c8d-43bb-4e2e-8460-977770de554f', 'volume_size': 1} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1442329881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4556c8d-43bb-4e2e-8460-977770de554f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5d6cec0a5a64fa3ab5eb6cfb643b1a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:06Z,use_quota=True,user_id='3396d2c4373c465ab3f3f87bfe5833c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Creating volume b4556c8d-43bb-4e2e-8460-977770de554f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:48:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:48:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:06 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f 1073741824 Nov 02 17:48:06 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:07 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f 1073741824" returned: 0 in 0.915s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:07 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f Nov 02 17:48:07 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-b6d2feb3-0ce7-4964-a06e-fd2bcc7c174b req-b67907a3-74fe-4ab9-a79b-58943b975f6f tempest-AttachVolumeShelveTestJSON-1388258993 None] No connector for attachment 601a1c14-dd03-4600-a588-18bab2712a04; skipping storage backend terminate_connection call. {{(pid=86585) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 17:48:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-b6d2feb3-0ce7-4964-a06e-fd2bcc7c174b req-b67907a3-74fe-4ab9-a79b-58943b975f6f tempest-AttachVolumeShelveTestJSON-1388258993 None] Deleting attachment 601a1c14-dd03-4600-a588-18bab2712a04. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:48:08 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f" returned: 0 in 0.613s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fedec0c-092d-44ac-9fd9-6d722e9a71ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4556c8d-43bb-4e2e-8460-977770de554f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96788832-ba0f-4873-b78b-25a366fb77f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Volume volume-b4556c8d-43bb-4e2e-8460-977770de554f (b4556c8d-43bb-4e2e-8460-977770de554f): created successfully Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96788832-ba0f-4873-b78b-25a366fb77f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Flow 'volume_create_manager' (4e921337-9702-478c-8802-e4b061c28e79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3fe6bc23-ee0e-4a63-8b96-34b9a6e4dd5d tempest-TaggedAttachmentsTest-364293192 None] Created volume successfully. Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Flow 'volume_create_manager' (f490bde8-5911-44d4-a26b-e9c2e5579da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab42c5e7-d1e4-4fda-a16e-3adb65d17aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab42c5e7-d1e4-4fda-a16e-3adb65d17aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-42673594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02916d7a-b020-4256-a862-9c869ab6470d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ac6c7e2be12419f9f7ecdc8fb3419d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:14Z,use_quota=True,user_id='0c5e2e8b3dab418e8692749243f3f759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28391fc0-4cd5-4606-8def-0c09b3c36841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28391fc0-4cd5-4606-8def-0c09b3c36841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8ff27e-1d43-489e-ba17-491dda76fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8ff27e-1d43-489e-ba17-491dda76fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02916d7a-b020-4256-a862-9c869ab6470d', 'volume_name': 'volume-02916d7a-b020-4256-a862-9c869ab6470d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5421f85-47f4-4a59-b0f5-c675646130ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5421f85-47f4-4a59-b0f5-c675646130ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749ef9af-c52a-41f5-bbac-c1341168068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Volume 02916d7a-b020-4256-a862-9c869ab6470d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02916d7a-b020-4256-a862-9c869ab6470d', 'volume_size': 1} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-42673594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02916d7a-b020-4256-a862-9c869ab6470d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ac6c7e2be12419f9f7ecdc8fb3419d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:14Z,use_quota=True,user_id='0c5e2e8b3dab418e8692749243f3f759',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Creating volume 02916d7a-b020-4256-a862-9c869ab6470d {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:48:13 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:48:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:13 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d 1073741824 Nov 02 17:48:13 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:14 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d 1073741824" returned: 0 in 0.765s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:14 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d Nov 02 17:48:14 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:15 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d" returned: 0 in 0.367s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749ef9af-c52a-41f5-bbac-c1341168068b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02916d7a-b020-4256-a862-9c869ab6470d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f52a162-629f-492f-9be8-93b0c0134136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Volume volume-02916d7a-b020-4256-a862-9c869ab6470d (02916d7a-b020-4256-a862-9c869ab6470d): created successfully Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f52a162-629f-492f-9be8-93b0c0134136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Flow 'volume_create_manager' (f490bde8-5911-44d4-a26b-e9c2e5579da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-51f48d94-eeeb-482f-b406-e54053c13a6f req-5ce965df-8664-4f9e-80b3-8fe7e9e23b73 tempest-VolumesGetTestJSON-1111412307 None] Created volume successfully. Nov 02 17:48:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Acquiring lock "cinder-02916d7a-b020-4256-a862-9c869ab6470d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Lock "cinder-02916d7a-b020-4256-a862-9c869ab6470d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Acquiring lock "cinder-quobyte-02916d7a-b020-4256-a862-9c869ab6470d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Lock "cinder-quobyte-02916d7a-b020-4256-a862-9c869ab6470d" acquired by "delete_volume" :: waited 0.052s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370abbe-5b34-449c-9fd1-cad098c191dd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:17 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d Nov 02 17:48:17 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:17 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d" returned: 0 in 0.927s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:17 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d Nov 02 17:48:17 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:18 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-02916d7a-b020-4256-a862-9c869ab6470d" returned: 0 in 0.720s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Lock "cinder-quobyte-02916d7a-b020-4256-a862-9c869ab6470d" released by "delete_volume" :: held 1.768s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG cinder.quota [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Created reservations ['ea593f99-cc48-4c91-9147-3820298434ec', '0bfa07c7-324e-4304-8d40-a004b705d78e', '31f4c168-8314-4acc-9b7d-19907d582416', 'cc0ee6e5-0fb6-427a-847c-e880c32f8311'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:18 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:48:18 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:19 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.486s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:19 devstack cinder-volume[86585]: DEBUG cinder.manager [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:48:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Deleted volume successfully. Nov 02 17:48:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-9a602e73-4de3-4d29-bd54-da5c650d1666 req-0c624521-641a-4212-aa52-42abd8ffe10a tempest-VolumesGetTestJSON-1111412307 None] Lock "cinder-02916d7a-b020-4256-a862-9c869ab6470d-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:28 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=13,cinder:UPDATE=16,cinder:INSERT=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:48:29 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=13,cinder:SELECT=8,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:48:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca86ff86-edbe-4098-acdd-0aa1d3159daa tempest-GroupSnapshotsV319Test-561284663 None] Group tempest-GroupSnapshotsV319Test-Group-1644487369: creating Nov 02 17:48:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca86ff86-edbe-4098-acdd-0aa1d3159daa tempest-GroupSnapshotsV319Test-561284663 None] Group tempest-GroupSnapshotsV319Test-Group-1644487369: created successfully Nov 02 17:48:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca86ff86-edbe-4098-acdd-0aa1d3159daa tempest-GroupSnapshotsV319Test-561284663 None] Create group completed successfully. Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Flow 'volume_create_manager' (9e592e7b-6938-459d-8aeb-527528527b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287af5e7-bc70-400b-be73-59f82a8597bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (287af5e7-bc70-400b-be73-59f82a8597bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-563326705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bca612ae-9ace-4dc5-b07f-0e63ebb4e6ac,host='devstack@QuobyteHD#QuobyteHD',id=ecfc529b-d43a-40cf-af05-35ae43be430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6546ad301e944020b9b94f2b22081022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:34Z,use_quota=True,user_id='ae1469023d6343f89e3cea57d6fadae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8987b2a-66f3-4143-bf04-5ec7060dd6a7),volume_type_id=a8987b2a-66f3-4143-bf04-5ec7060dd6a7)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15315139-401a-4757-923b-3e6ed9eaa50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15315139-401a-4757-923b-3e6ed9eaa50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2a3d96-795b-4aa3-9196-1f408d135067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2a3d96-795b-4aa3-9196-1f408d135067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecfc529b-d43a-40cf-af05-35ae43be430e', 'volume_name': 'volume-ecfc529b-d43a-40cf-af05-35ae43be430e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fdb858-677b-45eb-8f9c-9142f36005c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15fdb858-677b-45eb-8f9c-9142f36005c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c4b651-90c2-46ab-a612-db29c937a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Volume ecfc529b-d43a-40cf-af05-35ae43be430e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecfc529b-d43a-40cf-af05-35ae43be430e', 'volume_size': 1} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bca612ae-9ace-4dc5-b07f-0e63ebb4e6ac,created_at=2026-11-02T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-563326705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bca612ae-9ace-4dc5-b07f-0e63ebb4e6ac,host='devstack@QuobyteHD#QuobyteHD',id=ecfc529b-d43a-40cf-af05-35ae43be430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6546ad301e944020b9b94f2b22081022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:34Z,use_quota=True,user_id='ae1469023d6343f89e3cea57d6fadae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8987b2a-66f3-4143-bf04-5ec7060dd6a7),volume_type_id=a8987b2a-66f3-4143-bf04-5ec7060dd6a7)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Creating volume ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:48:34 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:34 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e 1073741824 Nov 02 17:48:34 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Flow 'volume_create_manager' (8865ea34-d326-4e7d-a190-87fe7310c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c71d64a-5196-4334-beeb-4549df8dbd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c71d64a-5196-4334-beeb-4549df8dbd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1274857580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2ff784-e05c-42df-b918-80e8e26c6fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cfeda50bd347248b5a16c258488b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:34Z,use_quota=True,user_id='9878231be45b43fb95fba96f14dd4788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a6a891-d0c3-4208-9706-a06c8239928c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6a6a891-d0c3-4208-9706-a06c8239928c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3535cab-c0c9-4f12-8d03-49b7067117f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3535cab-c0c9-4f12-8d03-49b7067117f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2ff784-e05c-42df-b918-80e8e26c6fbc', 'volume_name': 'volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4193a9f-13e6-4317-a8c3-99a5c3264a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4193a9f-13e6-4317-a8c3-99a5c3264a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578bccb5-b20b-42d9-888f-f07005116abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Volume 5b2ff784-e05c-42df-b918-80e8e26c6fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc', 'volume_size': 1} Nov 02 17:48:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:35 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e 1073741824" returned: 0 in 0.667s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:35 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e Nov 02 17:48:35 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:35 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e" returned: 0 in 0.282s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1274857580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2ff784-e05c-42df-b918-80e8e26c6fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cfeda50bd347248b5a16c258488b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:34Z,use_quota=True,user_id='9878231be45b43fb95fba96f14dd4788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Creating volume 5b2ff784-e05c-42df-b918-80e8e26c6fbc {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:48:35 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c4b651-90c2-46ab-a612-db29c937a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecfc529b-d43a-40cf-af05-35ae43be430e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:35 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc 1073741824 Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094e0e53-e793-4296-a3dd-44b5e767d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:35 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Volume volume-ecfc529b-d43a-40cf-af05-35ae43be430e (ecfc529b-d43a-40cf-af05-35ae43be430e): created successfully Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (094e0e53-e793-4296-a3dd-44b5e767d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Flow 'volume_create_manager' (9e592e7b-6938-459d-8aeb-527528527b94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-34e940ec-6f1b-4fae-aae6-38d0e0dbc59b tempest-GroupSnapshotsV319Test-561284663 None] Created volume successfully. Nov 02 17:48:36 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc 1073741824" returned: 0 in 0.525s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:36 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc Nov 02 17:48:36 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:36 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc" returned: 0 in 0.305s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (578bccb5-b20b-42d9-888f-f07005116abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e673af69-c94a-44a1-a353-ccb840e49ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:36 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Volume volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc (5b2ff784-e05c-42df-b918-80e8e26c6fbc): created successfully Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e673af69-c94a-44a1-a353-ccb840e49ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Flow 'volume_create_manager' (8865ea34-d326-4e7d-a190-87fe7310c530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6a9759cd-f829-400f-88c4-3e4d497920da tempest-ServersNegativeTestJSON-494919599 None] Created volume successfully. Nov 02 17:48:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] GroupSnapshot 14602d85-7e14-409c-8380-9b917271aa07: creating. Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Group snapshot 14602d85-7e14-409c-8380-9b917271aa07: creating. {{(pid=86585) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Creating offline snapshot 853fd137-c319-43e3-854d-8185c23eea0e of volume ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[685f0f95-c2d8-4d39-ae15-e9ca44b68925]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:37 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e Nov 02 17:48:37 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:37 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e" returned: 0 in 0.507s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:37 devstack sudo[88960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e 1G Nov 02 17:48:37 devstack sudo[88960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:38 devstack sudo[88960]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e 1G" returned: 0 in 0.526s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfc529b-d43a-40cf-af05-35ae43be430e -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:38 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfc529b-d43a-40cf-af05-35ae43be430e -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e Nov 02 17:48:38 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:38 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecfc529b-d43a-40cf-af05-35ae43be430e -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e" returned: 0 in 0.383s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:38 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:48:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:38 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e Nov 02 17:48:38 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:38 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:39 devstack sudo[88975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info Nov 02 17:48:39 devstack sudo[88975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Flow 'volume_create_manager' (0c804fd1-925d-4db9-aa90-4746a8a3c8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b59e21-9ea5-497a-badd-b0ea9e436519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b59e21-9ea5-497a-badd-b0ea9e436519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-361003495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a34741-bcb0-4498-8bd2-cd86ea730ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cfeda50bd347248b5a16c258488b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:39Z,use_quota=True,user_id='9878231be45b43fb95fba96f14dd4788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72edeb5d-fdc1-4351-866c-844dc7aa89cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72edeb5d-fdc1-4351-866c-844dc7aa89cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9b7750-dfae-49e1-b116-ace7f17f271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9b7750-dfae-49e1-b116-ace7f17f271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a34741-bcb0-4498-8bd2-cd86ea730ad7', 'volume_name': 'volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57081395-6a31-4c9f-ada7-708883652a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57081395-6a31-4c9f-ada7-708883652a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17d87f1-df4a-490a-98fd-9399be20bc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:39 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Volume 85a34741-bcb0-4498-8bd2-cd86ea730ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7', 'volume_size': 1} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:39 devstack sudo[88975]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info" returned: 0 in 0.298s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:39 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:39 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info Nov 02 17:48:39 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:39 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.info" returned: 0 in 0.277s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-361003495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a34741-bcb0-4498-8bd2-cd86ea730ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8cfeda50bd347248b5a16c258488b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:48:39Z,use_quota=True,user_id='9878231be45b43fb95fba96f14dd4788',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Creating volume 85a34741-bcb0-4498-8bd2-cd86ea730ad7 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:48:39 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:48:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:39 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 1073741824 Nov 02 17:48:39 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a9907826-6756-4b42-b731-ebbf69dfb7c1 tempest-GroupSnapshotsV319Test-561284663 None] group_snapshot 14602d85-7e14-409c-8380-9b917271aa07: created successfully Nov 02 17:48:40 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 1073741824" returned: 0 in 0.466s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:40 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 Nov 02 17:48:40 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:40 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7" returned: 0 in 0.294s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17d87f1-df4a-490a-98fd-9399be20bc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a401f1-0b04-4b98-a9bb-f31fffa65705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:48:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Volume volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 (85a34741-bcb0-4498-8bd2-cd86ea730ad7): created successfully Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a401f1-0b04-4b98-a9bb-f31fffa65705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Flow 'volume_create_manager' (0c804fd1-925d-4db9-aa90-4746a8a3c8b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:48:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0f4f298a-6a27-4f0c-a75c-bcfd39b1baee tempest-ServersNegativeTestJSON-494919599 None] Created volume successfully. Nov 02 17:48:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] group_snapshot 14602d85-7e14-409c-8380-9b917271aa07: deleting Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] group_snapshot 14602d85-7e14-409c-8380-9b917271aa07: deleting {{(pid=86585) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "cinder-quobyte-ecfc529b-d43a-40cf-af05-35ae43be430e" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Lock "cinder-quobyte-ecfc529b-d43a-40cf-af05-35ae43be430e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "cinder-quobyte-853fd137-c319-43e3-854d-8185c23eea0e" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Lock "cinder-quobyte-853fd137-c319-43e3-854d-8185c23eea0e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Deleting offline snapshot 853fd137-c319-43e3-854d-8185c23eea0e of volume ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] snapshot_file for this snap is: volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2225aaf5-c9e6-4600-a7c6-4d728b8d34f0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:41 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e Nov 02 17:48:41 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:41 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e" returned: 0 in 0.475s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecfc529b-d43a-40cf-af05-35ae43be430e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da03af8-279c-49a1-b4e2-12c2981b48bd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:41 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e Nov 02 17:48:41 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "cinder-85a34741-bcb0-4498-8bd2-cd86ea730ad7-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-85a34741-bcb0-4498-8bd2-cd86ea730ad7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "cinder-quobyte-85a34741-bcb0-4498-8bd2-cd86ea730ad7" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-quobyte-85a34741-bcb0-4498-8bd2-cd86ea730ad7" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1e6909-9f81-4590-9afa-761afdefdeab]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:42 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 Nov 02 17:48:42 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:42 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e" returned: 0 in 0.568s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:42 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e Nov 02 17:48:42 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:42 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:42 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7 Nov 02 17:48:42 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:42 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:42 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e Nov 02 17:48:42 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:42 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-85a34741-bcb0-4498-8bd2-cd86ea730ad7" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-quobyte-85a34741-bcb0-4498-8bd2-cd86ea730ad7" released by "delete_volume" :: held 0.888s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Created reservations ['9d68b7ac-27f3-4c3a-9928-c09d38875c72', 'd67ff6e5-68d5-43e6-ab8e-67098b444940', '8b2bd754-ce1b-4f5f-9d94-57f5ec378bda', '8a5cb55f-4f4b-420d-8f81-499197c93263'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:42 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e.853fd137-c319-43e3-854d-8185c23eea0e" returned: 0 in 0.360s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:42 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:48:42 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Lock "cinder-quobyte-853fd137-c319-43e3-854d-8185c23eea0e" released by "_delete_snapshot" :: held 2.033s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "cinder-5b2ff784-e05c-42df-b918-80e8e26c6fbc-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Lock "cinder-quobyte-ecfc529b-d43a-40cf-af05-35ae43be430e" released by "delete_snapshot" :: held 2.090s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-5b2ff784-e05c-42df-b918-80e8e26c6fbc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "cinder-quobyte-5b2ff784-e05c-42df-b918-80e8e26c6fbc" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:43 devstack cinder-volume[86585]: WARNING cinder.quota [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-569205027 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-569205027, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:48:43 devstack cinder-volume[86585]: WARNING cinder.quota [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-569205027 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-569205027, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-quobyte-5b2ff784-e05c-42df-b918-80e8e26c6fbc" acquired by "delete_volume" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] Created reservations ['879af4de-a52c-4cc0-ba7f-d550cdf9161e', '3d15a48e-4e0a-49a2-9d7a-bd7f1ef3063e', '37523c3e-edc4-471b-b1ad-1b123bcda9a2', '3956b9cd-c6be-441e-aeff-2716d1787d12'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[809af33a-4326-4713-8814-b0b056f8f073]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b22bd65d-475b-4fe3-8d00-55991b0a2146 tempest-GroupSnapshotsV319Test-561284663 None] group_snapshot 14602d85-7e14-409c-8380-9b917271aa07: deleted successfully Nov 02 17:48:43 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.533s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:48:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Deleted volume successfully. Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22dbd6f9-2997-472e-9bc0-cd050c6172a7 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-85a34741-bcb0-4498-8bd2-cd86ea730ad7-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:43 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc Nov 02 17:48:43 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "cinder-quobyte-ecfc529b-d43a-40cf-af05-35ae43be430e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Lock "cinder-quobyte-ecfc529b-d43a-40cf-af05-35ae43be430e" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eb350d-1eba-4535-8e6d-faf0612d5d1a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:48:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:44 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc" returned: 0 in 0.792s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:44 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc Nov 02 17:48:44 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:44 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e Nov 02 17:48:44 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:44 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5b2ff784-e05c-42df-b918-80e8e26c6fbc" returned: 0 in 0.322s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-quobyte-5b2ff784-e05c-42df-b918-80e8e26c6fbc" released by "delete_volume" :: held 1.173s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:44 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e" returned: 0 in 0.543s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Created reservations ['618e1fab-d7dc-4db0-bb7d-8ffb40677d2a', '55fb297d-6e3e-4f5f-a4d0-2d45f1e4f468', 'ebc43f08-6e30-45ea-8815-5884bf1e9f48', '5d3e3996-f86b-44f1-a3dc-0716a7aa2cae'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:44 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e Nov 02 17:48:44 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:44 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:48:44 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:44 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ecfc529b-d43a-40cf-af05-35ae43be430e" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Lock "cinder-quobyte-ecfc529b-d43a-40cf-af05-35ae43be430e" released by "delete_volume" :: held 0.956s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Created reservations ['1d5c686e-602d-4c38-aef7-bf32da375d8b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:44 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.306s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:48:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Deleted volume successfully. Nov 02 17:48:44 devstack cinder-volume[86585]: WARNING cinder.quota [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-569205027 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-569205027, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca327d81-c36e-4db3-984f-8149f8b4b9d2 tempest-ServersNegativeTestJSON-494919599 None] Lock "cinder-5b2ff784-e05c-42df-b918-80e8e26c6fbc-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:48:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Created reservations ['45a41b18-7896-4682-9838-1f7ca674beef', 'eb55abea-cd6e-4ea3-abb2-54a626875a5f', 'dfbd482d-37c6-4891-9016-acd757a2e083', '663001b1-474f-4f10-9dee-e7a571d525fe'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:45 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:48:45 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:45 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.282s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:45 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:48:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-513ce033-7c35-44da-87d3-425e9b0fbd39 tempest-GroupSnapshotsV319Test-561284663 None] Delete group completed successfully. Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:46 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:48:46 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:47 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:48:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4394af89-2464-45f1-8606-c225f8080bc1 tempest-GroupsV320Test-2140418795 None] Group tempest-GroupsV320Test-Group-933598845: creating Nov 02 17:48:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4394af89-2464-45f1-8606-c225f8080bc1 tempest-GroupsV320Test-2140418795 None] Group tempest-GroupsV320Test-Group-933598845: created successfully Nov 02 17:48:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4394af89-2464-45f1-8606-c225f8080bc1 tempest-GroupsV320Test-2140418795 None] Create group completed successfully. Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Created reservations ['3c148f7f-16bf-4ab6-ba9b-d0ba11cf51b9'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:48:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:48:55 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:48:55 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:48:55 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Nov 02 17:48:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.386s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:48:55 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:48:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3de6625c-7fc9-4413-91bf-723554fed91b tempest-GroupsV320Test-2140418795 None] Delete group completed successfully. Nov 02 17:48:58 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ae4e219-dc09-4709-a394-51e60bc9aa57 tempest-BackendsCapabilitiesAdminTestsJSON-1252378810 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7889251708984, 'free_capacity_gb': 1773.7889251708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86585) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 17:48:58 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0a8d00d5-04b1-4353-979e-a3993119afc0 tempest-BackendsCapabilitiesAdminTestsJSON-1252378810 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7889251708984, 'free_capacity_gb': 1773.7889251708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86585) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 17:49:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-3a466e87-5f8f-452f-bfeb-bee6596c09af req-c17ceb0c-ab69-46d4-b5b9-83b9d96f587d tempest-TaggedAttachmentsTest-364293192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-3a466e87-5f8f-452f-bfeb-bee6596c09af req-c17ceb0c-ab69-46d4-b5b9-83b9d96f587d tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-3a466e87-5f8f-452f-bfeb-bee6596c09af req-c17ceb0c-ab69-46d4-b5b9-83b9d96f587d tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-3a466e87-5f8f-452f-bfeb-bee6596c09af req-c17ceb0c-ab69-46d4-b5b9-83b9d96f587d tempest-TaggedAttachmentsTest-364293192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-b4556c8d-43bb-4e2e-8460-977770de554f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d3d4b0e-0e76-457c-bdec-9077bd823963', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:49:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-3a466e87-5f8f-452f-bfeb-bee6596c09af req-c17ceb0c-ab69-46d4-b5b9-83b9d96f587d tempest-TaggedAttachmentsTest-364293192 None] attachment_update completed successfully. Nov 02 17:49:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-3716d966-6eb9-442a-abf9-2864f2ccccc1 req-62534ec7-b924-4f55-80c7-6d23abd34b80 tempest-TaggedAttachmentsTest-364293192 None] Terminate volume connection completed successfully. Nov 02 17:49:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-3716d966-6eb9-442a-abf9-2864f2ccccc1 req-62534ec7-b924-4f55-80c7-6d23abd34b80 tempest-TaggedAttachmentsTest-364293192 None] Deleting attachment 7d3d4b0e-0e76-457c-bdec-9077bd823963. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Flow 'volume_create_manager' (2aa23868-0936-46f3-8193-39659528b988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50a4b7f-a4d9-4f14-87cc-348e11aaa6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50a4b7f-a4d9-4f14-87cc-348e11aaa6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1421364783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d030c5e2-152a-4c2d-b774-1707cbc4dc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6105f73792d428fbbe9d48150a4abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:06Z,use_quota=True,user_id='8898e8038c2f4c37943549aada47a6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6684f3-f7e6-4b3f-8666-a5e5842ca543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e6684f3-f7e6-4b3f-8666-a5e5842ca543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844d9889-a338-440b-8afc-2710d539b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (844d9889-a338-440b-8afc-2710d539b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd030c5e2-152a-4c2d-b774-1707cbc4dc48', 'volume_name': 'volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ada2857-70e9-4a49-aa6d-93a4c4d88456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ada2857-70e9-4a49-aa6d-93a4c4d88456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c050adf-7d4b-4233-a01a-4ace64272989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Volume d030c5e2-152a-4c2d-b774-1707cbc4dc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48', 'volume_size': 1} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1421364783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d030c5e2-152a-4c2d-b774-1707cbc4dc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6105f73792d428fbbe9d48150a4abc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:06Z,use_quota=True,user_id='8898e8038c2f4c37943549aada47a6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Creating volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:49:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:06 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 1073741824 Nov 02 17:49:06 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:06 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 1073741824" returned: 0 in 0.422s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:07 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 Nov 02 17:49:07 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:07 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48" returned: 0 in 0.262s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c050adf-7d4b-4233-a01a-4ace64272989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61f4d5e-83d2-4f4f-a6c8-105e4f01e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:07 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Volume volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 (d030c5e2-152a-4c2d-b774-1707cbc4dc48): created successfully Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61f4d5e-83d2-4f4f-a6c8-105e4f01e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Flow 'volume_create_manager' (2aa23868-0936-46f3-8193-39659528b988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9113d70e-569c-4527-b487-1ddbdc0becf3 tempest-SnapshotsActionsTest-1748113080 None] Created volume successfully. Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Creating offline snapshot 2092e58e-3739-454f-94c7-0a709559af7f of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a23ea9-692f-404b-a795-da15c94eed11]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:07 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 Nov 02 17:49:07 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:08 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48" returned: 0 in 0.396s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:08 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f 1G Nov 02 17:49:08 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:08 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f 1G" returned: 0 in 0.729s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:08 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:08 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:09 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:09 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f is being set with open permissions: ugo+rw Nov 02 17:49:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:09 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:09 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:09 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.402s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:09 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info Nov 02 17:49:09 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:09 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info" returned: 0 in 0.322s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:09 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info is being set with open permissions: ugo+rw Nov 02 17:49:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:10 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info Nov 02 17:49:10 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:10 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.info" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ad38ab8d-ac40-43b2-85a6-34ccec80024e tempest-SnapshotsActionsTest-1748113080 None] Create snapshot completed successfully Nov 02 17:49:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Creating offline snapshot 9adf4efa-0f96-40a2-bb68-dbca69491aa0 of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:49:12 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac4c74-6dd4-4907-b55a-fe2c8737126c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:12 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:12 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:12 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.541s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:12 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 1G Nov 02 17:49:12 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:13 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 1G" returned: 0 in 0.579s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:13 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 Nov 02 17:49:13 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:13 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0" returned: 0 in 0.339s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:13 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 is being set with open permissions: ugo+rw Nov 02 17:49:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:13 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 Nov 02 17:49:13 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:13 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0" returned: 0 in 0.292s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.908s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6067044d-d00b-473c-8eff-e7caef76e28b tempest-SnapshotsActionsTest-1748113080 None] Create snapshot completed successfully Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-9adf4efa-0f96-40a2-bb68-dbca69491aa0-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-9adf4efa-0f96-40a2-bb68-dbca69491aa0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-9adf4efa-0f96-40a2-bb68-dbca69491aa0" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-9adf4efa-0f96-40a2-bb68-dbca69491aa0" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Deleting offline snapshot 9adf4efa-0f96-40a2-bb68-dbca69491aa0 of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] snapshot_file for this snap is: volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0336bb1-ed28-4ca5-8fa5-e29a03e03974]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:14 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 Nov 02 17:49:14 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Acquiring lock "cinder-93985a2d-376e-4f8e-8853-0c606b361310-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Acquiring lock "cinder-b4556c8d-43bb-4e2e-8460-977770de554f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Lock "cinder-b4556c8d-43bb-4e2e-8460-977770de554f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "cinder-93985a2d-376e-4f8e-8853-0c606b361310-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Acquiring lock "cinder-quobyte-b4556c8d-43bb-4e2e-8460-977770de554f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Acquiring lock "cinder-quobyte-93985a2d-376e-4f8e-8853-0c606b361310" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Lock "cinder-quobyte-b4556c8d-43bb-4e2e-8460-977770de554f" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "cinder-quobyte-93985a2d-376e-4f8e-8853-0c606b361310" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f70279-8107-4ed3-90b8-467e4799caaa]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[043d826f-dd10-47ce-812d-61dcfe4b1926]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:14 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0" returned: 0 in 0.475s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:14 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f Nov 02 17:49:14 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[27891668-cbf4-498f-af9f-802b13d4d5a8]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:15 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 Nov 02 17:49:15 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:15 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:15 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:15 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310" returned: 0 in 0.392s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:15 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f" returned: 0 in 0.426s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:15 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310 Nov 02 17:49:15 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:15 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f Nov 02 17:49:15 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:15 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.423s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:15 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 Nov 02 17:49:15 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:15 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b4556c8d-43bb-4e2e-8460-977770de554f" returned: 0 in 0.278s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:15 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-93985a2d-376e-4f8e-8853-0c606b361310" returned: 0 in 0.309s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Lock "cinder-quobyte-b4556c8d-43bb-4e2e-8460-977770de554f" released by "delete_volume" :: held 0.768s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "cinder-quobyte-93985a2d-376e-4f8e-8853-0c606b361310" released by "delete_volume" :: held 0.764s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Created reservations ['fea11275-bd80-4b9e-9e70-ed4d48ceefec', '31d74ea6-e2fe-49dc-87c1-248fea3affde', '2237e414-c7bb-4e25-a9a0-dbfd756fefd9', '298738c4-7419-4846-96a9-93b9270a2581'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Created reservations ['7da6c75e-f732-4e52-a1c1-3eb1a540e6f6', '068bd07f-e74d-420e-b7c1-536a39a8be85', '6c8ecbf3-b78a-43d9-9b0f-6b65d9336027', '1fcac5ff-41bc-47cf-80f6-ddfa15eff757'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:15 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:15 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:15 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:15 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:16 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Flow 'volume_create_manager' (c1fe7993-014a-421c-bcf0-8809a7fea0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6fcf5a-9ca9-4173-9e84-0a291bf684b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0" returned: 0 in 0.634s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:16 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0 Nov 02 17:49:16 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a6fcf5a-9ca9-4173-9e84-0a291bf684b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1080126436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc245ddc-3315-4e9f-aaea-f1ee9d908009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2507f79a9d93457881e5280c8bf0b084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:16Z,use_quota=True,user_id='688d5dafa92f4f90be9c06fe3c967017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e2a7d0-91e7-46d9-8cba-568b6e1556ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e2a7d0-91e7-46d9-8cba-568b6e1556ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cc7da2-1992-462d-b409-8f0c8aa1585a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cc7da2-1992-462d-b409-8f0c8aa1585a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc245ddc-3315-4e9f-aaea-f1ee9d908009', 'volume_name': 'volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50997519-80a2-44f8-afa7-ca9290c85a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50997519-80a2-44f8-afa7-ca9290c85a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978f90cb-986b-4bbc-8fd6-f7f8d9c30b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Volume dc245ddc-3315-4e9f-aaea-f1ee9d908009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009', 'volume_size': 1} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1080126436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc245ddc-3315-4e9f-aaea-f1ee9d908009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2507f79a9d93457881e5280c8bf0b084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:16Z,use_quota=True,user_id='688d5dafa92f4f90be9c06fe3c967017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Creating volume dc245ddc-3315-4e9f-aaea-f1ee9d908009 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:49:16 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:16 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Deleted volume successfully. Nov 02 17:49:16 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:16 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 1073741824 Nov 02 17:49:16 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.371s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Deleted volume successfully. Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e69e963a-7ea3-4844-a236-cba133cc5e51 tempest-TaggedAttachmentsTest-364293192 None] Lock "cinder-b4556c8d-43bb-4e2e-8460-977770de554f-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2da068e6-5901-47ff-9e20-4fe5735b0f3b tempest-AttachVolumeShelveTestJSON-1388258993 None] Lock "cinder-93985a2d-376e-4f8e-8853-0c606b361310-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:16 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9adf4efa-0f96-40a2-bb68-dbca69491aa0" returned: 0 in 0.362s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-9adf4efa-0f96-40a2-bb68-dbca69491aa0" released by "_delete_snapshot" :: held 2.049s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" released by "delete_snapshot" :: held 2.107s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:16 devstack cinder-volume[86585]: WARNING cinder.quota [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Created reservations ['14e329f9-85e6-419f-92f3-bfec44e2874d', 'a0dfbd82-f98d-4523-bb83-b25b5faaecc5', 'e29a4a54-8355-4840-af39-11c08610ae4f', 'b738ff35-61fd-4a8b-a306-4082c3aa18dc'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Delete snapshot completed successfully. Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1ea34d4-4dda-4417-9d62-c97e5f50514c tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-9adf4efa-0f96-40a2-bb68-dbca69491aa0-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:16 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 1073741824" returned: 0 in 0.575s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:16 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 Nov 02 17:49:16 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:17 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978f90cb-986b-4bbc-8fd6-f7f8d9c30b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c07e291-2e7f-4ff8-bf07-0eac1ae9638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:17 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Volume volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 (dc245ddc-3315-4e9f-aaea-f1ee9d908009): created successfully Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c07e291-2e7f-4ff8-bf07-0eac1ae9638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Flow 'volume_create_manager' (c1fe7993-014a-421c-bcf0-8809a7fea0df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-258647cf-d88f-44e3-a266-818ab6e64dbb tempest-VolumeQuotasAdminTestJSON-287764557 None] Created volume successfully. Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Creating offline snapshot 9ee801bc-9bde-4c9c-bda3-fe4affbec966 of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d8f4d-1010-414c-b6af-0a8c873fd7f3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:18 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:18 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "cinder-dc245ddc-3315-4e9f-aaea-f1ee9d908009-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "cinder-dc245ddc-3315-4e9f-aaea-f1ee9d908009-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "cinder-quobyte-dc245ddc-3315-4e9f-aaea-f1ee9d908009" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "cinder-quobyte-dc245ddc-3315-4e9f-aaea-f1ee9d908009" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d81770-42e2-4e99-9099-40dadb96b159]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:18 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.462s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:18 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 Nov 02 17:49:18 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:18 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 1G Nov 02 17:49:18 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:18 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009" returned: 0 in 0.487s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:18 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009 Nov 02 17:49:18 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:19 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 1G" returned: 0 in 0.591s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:19 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 Nov 02 17:49:19 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:19 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-dc245ddc-3315-4e9f-aaea-f1ee9d908009" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "cinder-quobyte-dc245ddc-3315-4e9f-aaea-f1ee9d908009" released by "delete_volume" :: held 0.832s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Created reservations ['f1504e0e-0def-45e2-b02a-2ac5dd85701d', 'f8152347-a615-4ba5-a9fc-a11ebbb921d0', 'b478a415-8d71-455b-bba4-b2a7cc4291c4', 'b39f0aab-d65c-427f-adc1-8a18bfa965c2'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:19 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:19 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:19 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966" returned: 0 in 0.316s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:19 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 is being set with open permissions: ugo+rw Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:19 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 Nov 02 17:49:19 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:19 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.300s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Deleted volume successfully. Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-32d8df04-5e59-4c7c-9eda-16cf885cc4a0 tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "cinder-dc245ddc-3315-4e9f-aaea-f1ee9d908009-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:19 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966" returned: 0 in 0.335s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-45058b78-abb9-4bee-bd8f-9db061e5741c tempest-SnapshotsActionsTest-1748113080 None] Create snapshot completed successfully Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Flow 'volume_create_manager' (51a3426d-0a13-4380-8d8b-66e8380d5678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea286acf-6e17-46d8-877d-472f17efda40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-9ee801bc-9bde-4c9c-bda3-fe4affbec966-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea286acf-6e17-46d8-877d-472f17efda40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-495490771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87d899a-e349-42d9-95e0-88cf99d9ad74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2507f79a9d93457881e5280c8bf0b084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:20Z,use_quota=True,user_id='688d5dafa92f4f90be9c06fe3c967017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d275133-33c5-44f5-b392-c77e3d2c9ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d275133-33c5-44f5-b392-c77e3d2c9ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaef955-3b92-4a75-94a8-7d9b823cd392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eaef955-3b92-4a75-94a8-7d9b823cd392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87d899a-e349-42d9-95e0-88cf99d9ad74', 'volume_name': 'volume-c87d899a-e349-42d9-95e0-88cf99d9ad74', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5602c15-ffd8-4d82-ada9-b3b0f0925d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5602c15-ffd8-4d82-ada9-b3b0f0925d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531ac8cb-ce91-4f95-9334-2a3af653b208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:20 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Volume c87d899a-e349-42d9-95e0-88cf99d9ad74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87d899a-e349-42d9-95e0-88cf99d9ad74', 'volume_size': 1} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-495490771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87d899a-e349-42d9-95e0-88cf99d9ad74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2507f79a9d93457881e5280c8bf0b084',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:20Z,use_quota=True,user_id='688d5dafa92f4f90be9c06fe3c967017',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Creating volume c87d899a-e349-42d9-95e0-88cf99d9ad74 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:49:20 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:20 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 1073741824 Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-9ee801bc-9bde-4c9c-bda3-fe4affbec966-delete_snapshot" acquired by "delete_snapshot" :: waited 0.128s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:20 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-9ee801bc-9bde-4c9c-bda3-fe4affbec966" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-9ee801bc-9bde-4c9c-bda3-fe4affbec966" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Deleting offline snapshot 9ee801bc-9bde-4c9c-bda3-fe4affbec966 of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] snapshot_file for this snap is: volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6d46d4-abcf-4672-8eb3-683cbc0ce74f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:20 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 Nov 02 17:49:20 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:20 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 1073741824" returned: 0 in 0.556s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:20 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966" returned: 0 in 0.477s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:20 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 Nov 02 17:49:20 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e5de74-00cf-4c21-a00e-a83ec430d975]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:21 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:21 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:21 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74" returned: 0 in 0.398s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (531ac8cb-ce91-4f95-9334-2a3af653b208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87d899a-e349-42d9-95e0-88cf99d9ad74', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0468e156-3548-4bff-a9c2-f5ca9d477e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Volume volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 (c87d899a-e349-42d9-95e0-88cf99d9ad74): created successfully Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0468e156-3548-4bff-a9c2-f5ca9d477e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Flow 'volume_create_manager' (51a3426d-0a13-4380-8d8b-66e8380d5678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-599ae6ee-05fc-46c1-9335-b50b132be6fb tempest-VolumeQuotasAdminTestJSON-287764557 None] Created volume successfully. Nov 02 17:49:21 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.467s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:21 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 Nov 02 17:49:21 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:21 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966" returned: 0 in 0.439s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:21 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966 Nov 02 17:49:21 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:22 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.9ee801bc-9bde-4c9c-bda3-fe4affbec966" returned: 0 in 0.363s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-9ee801bc-9bde-4c9c-bda3-fe4affbec966" released by "_delete_snapshot" :: held 1.950s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" released by "delete_snapshot" :: held 1.983s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:22 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Created reservations ['6bd5220f-033d-4579-b508-912ea95a1ac4', '6856a8e2-d421-45e6-8475-5d070b8a5451', 'a1fb9448-a582-4dcc-8657-b4d532a0457a', '2e654a69-cb26-42b3-a1b5-706d755acb25'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Delete snapshot completed successfully. Nov 02 17:49:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51fb23f5-f138-4e7b-ac0f-85a67333b5e5 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-9ee801bc-9bde-4c9c-bda3-fe4affbec966-delete_snapshot" released by "delete_snapshot" :: held 2.207s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-650c8969-cf80-4402-a8b3-ef766170bda7 tempest-VolumeQuotasAdminTestJSON-1183632754 None] Transfer volume completed successfully. Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Acquiring lock "cinder-c87d899a-e349-42d9-95e0-88cf99d9ad74-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Lock "cinder-c87d899a-e349-42d9-95e0-88cf99d9ad74-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Acquiring lock "cinder-quobyte-c87d899a-e349-42d9-95e0-88cf99d9ad74" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Creating offline snapshot cf019c84-bdb1-4f4b-969f-aa5e2849ccfe of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Lock "cinder-quobyte-c87d899a-e349-42d9-95e0-88cf99d9ad74" acquired by "delete_volume" :: waited 0.067s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7374d31-5e1a-4eb9-a17a-c19427a1e892]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[670bb3d9-9a37-42cd-b305-c885236fa848]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:24 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:24 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:24 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 Nov 02 17:49:24 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:24 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74" returned: 0 in 0.454s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:24 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.482s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:24 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74 Nov 02 17:49:24 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:24 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe 1G Nov 02 17:49:24 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:24 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c87d899a-e349-42d9-95e0-88cf99d9ad74" returned: 0 in 0.263s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Lock "cinder-quobyte-c87d899a-e349-42d9-95e0-88cf99d9ad74" released by "delete_volume" :: held 0.776s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Created reservations ['25c3a6f6-2794-460d-a40f-86ce75634640', '70149830-225a-460c-901c-7af628d7204f', 'ac82cbc7-ef31-42de-9937-03d0a58141a6', '1e585645-e6ce-4ad3-9f9a-52c9d9652d05'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:24 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:24 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:24 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe 1G" returned: 0 in 0.580s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:25 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe Nov 02 17:49:25 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:25 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Deleted volume successfully. Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a575f93d-15c7-4b2d-afe0-99c136825a97 tempest-VolumeQuotasAdminTestJSON-1860628472 None] Lock "cinder-c87d899a-e349-42d9-95e0-88cf99d9ad74-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:25 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" returned: 0 in 0.602s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:25 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe is being set with open permissions: ugo+rw Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:25 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe Nov 02 17:49:25 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:25 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" returned: 0 in 0.322s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.163s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-60ae3fed-0b42-4de5-ab20-1cacc6e63ff5 tempest-SnapshotsActionsTest-1748113080 None] Create snapshot completed successfully Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-cf019c84-bdb1-4f4b-969f-aa5e2849ccfe-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-cf019c84-bdb1-4f4b-969f-aa5e2849ccfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Deleting offline snapshot cf019c84-bdb1-4f4b-969f-aa5e2849ccfe of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] snapshot_file for this snap is: volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb920b59-cd65-4534-b186-4f3f0095189e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:27 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe Nov 02 17:49:27 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:27 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" returned: 0 in 0.428s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2633718-4188-4791-8eae-fd018e7beb5c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:27 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:27 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:28 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.445s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:28 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe Nov 02 17:49:28 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:28 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" returned: 0 in 0.544s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:28 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe Nov 02 17:49:28 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:28 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-cf019c84-bdb1-4f4b-969f-aa5e2849ccfe" released by "_delete_snapshot" :: held 1.811s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" released by "delete_snapshot" :: held 1.843s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=106,cinder:UPDATE=111,cinder:DELETE=9,cinder:INSERT=26 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Created reservations ['ff6773e7-5b47-4575-aa86-8f2914045feb', 'd8464fee-2e23-4cec-8c80-87fcf53b363a', '8cb27ff7-2a28-4fae-85b6-84c6cd845405', 'dbdae2ec-f961-45c8-b271-f65ef8553fcf'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Delete snapshot completed successfully. Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c91afffc-9b1f-4258-81a0-0068df6775a1 tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-cf019c84-bdb1-4f4b-969f-aa5e2849ccfe-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=101,cinder:UPDATE=107,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Creating offline snapshot b9da48ef-3fd6-4f16-89a2-a6f30420b402 of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c48f2e-6289-41c8-a372-4daf9d846179]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:30 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:30 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:30 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.507s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:30 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 1G Nov 02 17:49:30 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:31 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 1G" returned: 0 in 0.700s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:31 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 Nov 02 17:49:31 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:31 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402" returned: 0 in 0.332s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:31 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 is being set with open permissions: ugo+rw Nov 02 17:49:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:31 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 Nov 02 17:49:31 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:31 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402" returned: 0 in 0.301s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1965c341-5616-4ac0-a398-64c56e06ed80 tempest-SnapshotsActionsTest-1748113080 None] Create snapshot completed successfully Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-b9da48ef-3fd6-4f16-89a2-a6f30420b402-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-b9da48ef-3fd6-4f16-89a2-a6f30420b402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Acquiring lock "cinder-quobyte-b9da48ef-3fd6-4f16-89a2-a6f30420b402" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-b9da48ef-3fd6-4f16-89a2-a6f30420b402" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Deleting offline snapshot b9da48ef-3fd6-4f16-89a2-a6f30420b402 of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] snapshot_file for this snap is: volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef95df2c-1d99-4e10-8c24-0162f141e9b6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:33 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 Nov 02 17:49:33 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:33 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402" returned: 0 in 0.503s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9191d-848e-4d02-b35e-f0453019c526]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:33 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:33 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:34 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.452s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:34 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 Nov 02 17:49:34 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:34 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:34 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402 Nov 02 17:49:34 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:35 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.b9da48ef-3fd6-4f16-89a2-a6f30420b402" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-b9da48ef-3fd6-4f16-89a2-a6f30420b402" released by "_delete_snapshot" :: held 1.860s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" released by "delete_snapshot" :: held 1.896s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Created reservations ['f0064648-882a-417d-a63d-4182643693c4', '8a3e96d9-5d9f-491c-9a7c-25de1105d7be', 'be12be75-1efb-4e5f-bf82-194edceafece', '7f6aa31b-76c9-45c3-8bbe-29cd22548c0a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Delete snapshot completed successfully. Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-df036e2b-0591-4397-b28e-8581382d726a tempest-SnapshotsActionsTest-1882171138 None] Lock "cinder-b9da48ef-3fd6-4f16-89a2-a6f30420b402-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Flow 'volume_create_manager' (3bb35338-cf4a-4860-9348-e1a58fdeea98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dca10e-7203-402c-9992-0ea13547ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dca10e-7203-402c-9992-0ea13547ca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1270996910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2773d4de2b646d68964058d24f5c4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:35Z,use_quota=True,user_id='68840c3ef35145b7a53130f2a313a5bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2c88c16-3e73-45f6-a3b1-b6fb53511563),volume_type_id=a2c88c16-3e73-45f6-a3b1-b6fb53511563)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486a723-c2ee-4249-89d2-f5a0753c8f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6486a723-c2ee-4249-89d2-f5a0753c8f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efae1a4c-be7f-41f9-b8d3-c6fa853a7346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efae1a4c-be7f-41f9-b8d3-c6fa853a7346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb', 'volume_name': 'volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a993736-b90f-4042-8287-9582d4402131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a993736-b90f-4042-8287-9582d4402131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8610549c-3ddd-4450-823c-409ce2b0473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Volume ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb', 'volume_size': 1} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1270996910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2773d4de2b646d68964058d24f5c4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:35Z,use_quota=True,user_id='68840c3ef35145b7a53130f2a313a5bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2c88c16-3e73-45f6-a3b1-b6fb53511563),volume_type_id=a2c88c16-3e73-45f6-a3b1-b6fb53511563)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Creating volume ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:49:35 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:49:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:35 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb 1073741824 Nov 02 17:49:35 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:36 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb 1073741824" returned: 0 in 0.597s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "cinder-2092e58e-3739-454f-94c7-0a709559af7f-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-2092e58e-3739-454f-94c7-0a709559af7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "cinder-quobyte-2092e58e-3739-454f-94c7-0a709559af7f" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:36 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb Nov 02 17:49:36 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-quobyte-2092e58e-3739-454f-94c7-0a709559af7f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Deleting offline snapshot 2092e58e-3739-454f-94c7-0a709559af7f of volume d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] snapshot_file for this snap is: volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e8cbc1-cfee-4624-bef0-e94a2376815f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:36 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:36 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:36 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb" returned: 0 in 0.312s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8610549c-3ddd-4450-823c-409ce2b0473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3376b698-6e07-4b7c-8fe3-ae867a938f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:36 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Volume volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb (ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb): created successfully Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3376b698-6e07-4b7c-8fe3-ae867a938f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Flow 'volume_create_manager' (3bb35338-cf4a-4860-9348-e1a58fdeea98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7565570f-d4a7-4b41-a63f-095339272ffc tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Created volume successfully. Nov 02 17:49:36 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.457s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[155427ac-71ec-48a7-b37a-b772e6b28bc4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:36 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 Nov 02 17:49:36 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:37 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48" returned: 0 in 0.447s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:37 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:37 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:37 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.481s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:37 devstack sudo[90058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f Nov 02 17:49:37 devstack sudo[90058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:38 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:38 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:38 devstack sudo[90058]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48.2092e58e-3739-454f-94c7-0a709559af7f" returned: 0 in 0.331s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-quobyte-2092e58e-3739-454f-94c7-0a709559af7f" released by "_delete_snapshot" :: held 1.897s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" released by "delete_snapshot" :: held 1.941s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Created reservations ['6e125a16-7269-40a8-a220-07114e6e1c33', '8632db33-7d8a-4fed-92e5-9f1049c14466', '0b5a46d5-a25e-469c-a80e-81ce69df05d5', '86e63f0c-3006-4719-894d-0c482708c556'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:38 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dade6116-8af5-4201-b4c8-a7c3e1be2ade tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Retype volume completed successfully. Nov 02 17:49:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Delete snapshot completed successfully. Nov 02 17:49:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-da109d69-4b9d-41c2-bb9f-5ed549884cb5 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-2092e58e-3739-454f-94c7-0a709559af7f-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "cinder-d030c5e2-152a-4c2d-b774-1707cbc4dc48-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-d030c5e2-152a-4c2d-b774-1707cbc4dc48-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Acquiring lock "cinder-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "cinder-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553181e-f03c-4cb6-a717-f4146699f98f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Acquiring lock "cinder-quobyte-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "cinder-quobyte-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:49:39 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec1a2e6-2c90-4d55-8572-84e2ff8e8a38]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:39 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:40 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb Nov 02 17:49:40 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:40 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48" returned: 0 in 0.518s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:40 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48 Nov 02 17:49:40 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:40 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb" returned: 0 in 0.542s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:40 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb Nov 02 17:49:40 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:40 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d030c5e2-152a-4c2d-b774-1707cbc4dc48" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-quobyte-d030c5e2-152a-4c2d-b774-1707cbc4dc48" released by "delete_volume" :: held 0.968s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Created reservations ['7e5ae9a5-a74a-434b-ba53-ff0afcaa47e7', 'bb1e2514-bf73-4513-8b4a-78be831122af', 'e527b8a7-c0b3-48b0-b6f3-5af863ee1646', '77a9e080-2af7-4e86-9306-7de058484eda'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:40 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb" returned: 0 in 0.329s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "cinder-quobyte-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb" released by "delete_volume" :: held 0.943s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:40 devstack cinder-volume[86585]: WARNING cinder.quota [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:49:40 devstack cinder-volume[86585]: WARNING cinder.quota [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:40 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Created reservations ['e7c57838-dc1a-45a3-a9a4-58f743f15e10', '620480e9-e6de-4932-97bd-c262b278d4ef', '70cfe3ae-a9c1-4da3-b145-37f0fd6d211d', '30f315c7-411b-412f-80d1-1e16f4f3b64a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:49:40 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:40 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:41 devstack sudo[90082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:41 devstack sudo[90082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:41 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.301s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Deleted volume successfully. Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-92172924-1d44-4162-a6ae-4bad9ce61655 tempest-SnapshotsActionsTest-1748113080 None] Lock "cinder-d030c5e2-152a-4c2d-b774-1707cbc4dc48-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:41 devstack sudo[90082]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Deleted volume successfully. Nov 02 17:49:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-50b8a174-703e-4968-9a63-8e2acc4017c5 tempest-VolumeRetypeWithoutMigrationTest-45454630 None] Lock "cinder-ba6c8a72-f3b3-4048-83a2-b5d4c6260dfb-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:46 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:49:46 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:46 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.387s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 8 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:49:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:49:51 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=27,cinder:DELETE=1,cinder:INSERT=7,cinder:UPDATE=38 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:49:51 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:INSERT=13,cinder:UPDATE=39,cinder:SELECT=36,cinder:DELETE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Flow 'volume_create_manager' (6e0243d5-5c8a-47d9-8abb-53e0b6efaf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c59b5b-aea6-4625-9634-a0cf4f29b422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c59b5b-aea6-4625-9634-a0cf4f29b422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1802442033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008fd956-9dd5-4742-ae65-d7d73a9fe1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2627441b9d4047dda03019b2bec136df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:54Z,use_quota=True,user_id='03e8699a91fa4ad18e509cac6258d0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4140d173-7bca-48f0-8637-c15c2dc64e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4140d173-7bca-48f0-8637-c15c2dc64e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19855759-9dc0-4ed5-b5c2-167c7206f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19855759-9dc0-4ed5-b5c2-167c7206f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '008fd956-9dd5-4742-ae65-d7d73a9fe1b9', 'volume_name': 'volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1f9bca-7b79-49c0-ae44-595cf3612794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c1f9bca-7b79-49c0-ae44-595cf3612794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef86637e-4a35-4ec9-9384-ce19a024b8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:54 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Volume 008fd956-9dd5-4742-ae65-d7d73a9fe1b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9', 'volume_size': 1} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1802442033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=008fd956-9dd5-4742-ae65-d7d73a9fe1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2627441b9d4047dda03019b2bec136df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:49:54Z,use_quota=True,user_id='03e8699a91fa4ad18e509cac6258d0a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Creating volume 008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:49:54 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:54 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 1073741824 Nov 02 17:49:54 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:54 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 1073741824" returned: 0 in 0.767s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:55 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 Nov 02 17:49:55 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:55 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" returned: 0 in 0.535s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef86637e-4a35-4ec9-9384-ce19a024b8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bf0650-e370-49a3-8e27-83d50ce62853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:49:55 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Volume volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 (008fd956-9dd5-4742-ae65-d7d73a9fe1b9): created successfully Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63bf0650-e370-49a3-8e27-83d50ce62853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:49:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Flow 'volume_create_manager' (6e0243d5-5c8a-47d9-8abb-53e0b6efaf01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:49:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2830b9c6-d168-4dc6-8608-040914c20770 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Created volume successfully. Nov 02 17:49:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:49:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:49:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Creating offline snapshot dc0ab5d5-0a73-4998-8394-c516162e43d4 of volume 008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:49:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6682049c-0d70-4acf-8c7d-3d000204ab26]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:49:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:57 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 Nov 02 17:49:57 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:57 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" returned: 0 in 0.738s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:57 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 1G Nov 02 17:49:57 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:58 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 1G" returned: 0 in 1.304s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:59 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 Nov 02 17:49:59 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:49:59 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Nov 02 17:49:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4" returned: 0 in 0.846s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:49:59 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 is being set with open permissions: ugo+rw Nov 02 17:49:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:49:59 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 Nov 02 17:49:59 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:00 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4" returned: 0 in 0.533s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:00 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info Nov 02 17:50:00 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:01 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info" returned: 0 in 0.724s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:01 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info is being set with open permissions: ugo+rw Nov 02 17:50:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:01 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info Nov 02 17:50:01 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:01 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.info" returned: 0 in 0.354s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.709s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9ef62b00-3a06-4112-b1cc-9ab7e20fc55d tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Create snapshot completed successfully Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "cinder-dc0ab5d5-0a73-4998-8394-c516162e43d4-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-dc0ab5d5-0a73-4998-8394-c516162e43d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "cinder-quobyte-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-quobyte-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "cinder-quobyte-dc0ab5d5-0a73-4998-8394-c516162e43d4" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-quobyte-dc0ab5d5-0a73-4998-8394-c516162e43d4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Deleting offline snapshot dc0ab5d5-0a73-4998-8394-c516162e43d4 of volume 008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] snapshot_file for this snap is: volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c88a0fe-8b7c-42d3-b6ae-9ac840cc2b45]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:03 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 Nov 02 17:50:03 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:03 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4" returned: 0 in 0.614s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b611fbe8-3f7b-427f-9e22-1ebac51a95a2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:04 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 Nov 02 17:50:04 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:04 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" returned: 0 in 0.726s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:04 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 Nov 02 17:50:04 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:05 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4" returned: 0 in 0.872s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:05 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4 Nov 02 17:50:05 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:05 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9.dc0ab5d5-0a73-4998-8394-c516162e43d4" returned: 0 in 0.406s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-quobyte-dc0ab5d5-0a73-4998-8394-c516162e43d4" released by "_delete_snapshot" :: held 2.838s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-quobyte-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" released by "delete_snapshot" :: held 2.874s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Created reservations ['1bdab88e-12f4-4c6c-beb4-63492e17ca86', 'bff2ee10-ae66-4a62-9b31-0298fdd5a67c', '8877d002-95d5-4755-9055-ac8325ce3362', 'ebdd5899-15a6-4ffd-b6a4-3fe50d0be941'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Delete snapshot completed successfully. Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-143de27c-6e05-4cdf-a0ff-b04d0c3ef0c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-dc0ab5d5-0a73-4998-8394-c516162e43d4-delete_snapshot" released by "delete_snapshot" :: held 3.047s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "cinder-008fd956-9dd5-4742-ae65-d7d73a9fe1b9-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-008fd956-9dd5-4742-ae65-d7d73a9fe1b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "cinder-quobyte-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-quobyte-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607e1ce-03e1-45f8-9162-df10d5fc2730]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:06 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 Nov 02 17:50:06 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:07 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" returned: 0 in 0.455s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:07 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9 Nov 02 17:50:07 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:07 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-quobyte-008fd956-9dd5-4742-ae65-d7d73a9fe1b9" released by "delete_volume" :: held 0.780s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Created reservations ['1c79b9ce-0dfb-4eaf-8435-8f18b9b2230f', '304b6abb-1ae6-47bf-9af2-173a83b727b3', 'b3f67af1-991b-4bb5-8556-a0a97dbcc690', 'cf132359-bf7d-4479-a898-c38767947c84'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:07 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:07 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:07 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.334s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Deleted volume successfully. Nov 02 17:50:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-579e0cb2-11bb-47ba-991e-54fdd4c01451 tempest-VolumeSnapshotQuotasNegativeTestJSON-212267371 None] Lock "cinder-008fd956-9dd5-4742-ae65-d7d73a9fe1b9-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:17 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=21,cinder:SELECT=18,cinder:INSERT=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:50:17 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=16,cinder:DELETE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Flow 'volume_create_manager' (860c48a5-49d1-4e11-905e-59a188d011b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b676d26c-647a-4e02-8f4a-11832f3c67c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b676d26c-647a-4e02-8f4a-11832f3c67c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1990066684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ddb460-45ab-40af-a02c-2b42720e6611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da577df99b9540479a88042cd591371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:18Z,use_quota=True,user_id='9208a0aa7078495fa2787c67451a6992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bc92e8-9303-4114-9d5e-cacc127a69f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93bc92e8-9303-4114-9d5e-cacc127a69f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04979e01-e873-48eb-a461-599a0731b7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04979e01-e873-48eb-a461-599a0731b7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ddb460-45ab-40af-a02c-2b42720e6611', 'volume_name': 'volume-a2ddb460-45ab-40af-a02c-2b42720e6611', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a67879-2ac3-41b2-ba3a-f5eef6d59f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a67879-2ac3-41b2-ba3a-f5eef6d59f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269b23ad-a85b-45ac-8ccf-19f1a9466092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Volume a2ddb460-45ab-40af-a02c-2b42720e6611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ddb460-45ab-40af-a02c-2b42720e6611', 'volume_size': 1} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1990066684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ddb460-45ab-40af-a02c-2b42720e6611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da577df99b9540479a88042cd591371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:18Z,use_quota=True,user_id='9208a0aa7078495fa2787c67451a6992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Creating volume a2ddb460-45ab-40af-a02c-2b42720e6611 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:18 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:18 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 1073741824 Nov 02 17:50:18 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:18 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 1073741824" returned: 0 in 0.508s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:18 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 Nov 02 17:50:18 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:19 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611" returned: 0 in 0.257s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269b23ad-a85b-45ac-8ccf-19f1a9466092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ddb460-45ab-40af-a02c-2b42720e6611', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bcf860-3ae8-4c6d-9eb3-cdfbeacd3bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:19 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Volume volume-a2ddb460-45ab-40af-a02c-2b42720e6611 (a2ddb460-45ab-40af-a02c-2b42720e6611): created successfully Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04bcf860-3ae8-4c6d-9eb3-cdfbeacd3bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Flow 'volume_create_manager' (860c48a5-49d1-4e11-905e-59a188d011b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e5bd3d0d-eb30-4f80-b9ce-a743d0972dcb tempest-AttachVolumeTestJSON-713895963 None] Created volume successfully. Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ed892c17-de4e-481b-a153-749f0c5e665b req-c781be94-9241-45de-aa73-a69b69d613f5 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ed892c17-de4e-481b-a153-749f0c5e665b req-c781be94-9241-45de-aa73-a69b69d613f5 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ed892c17-de4e-481b-a153-749f0c5e665b req-c781be94-9241-45de-aa73-a69b69d613f5 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-ed892c17-de4e-481b-a153-749f0c5e665b req-c781be94-9241-45de-aa73-a69b69d613f5 tempest-AttachVolumeTestJSON-713895963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-a2ddb460-45ab-40af-a02c-2b42720e6611', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e35af61e-4ccd-4f94-a383-c531ce0e7792', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:50:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-ed892c17-de4e-481b-a153-749f0c5e665b req-c781be94-9241-45de-aa73-a69b69d613f5 tempest-AttachVolumeTestJSON-713895963 None] attachment_update completed successfully. Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Flow 'volume_create_manager' (3f3546d1-f3d5-4248-aee6-06df3533d278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25f938b-554c-4bcb-9f4e-33c8be39eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d25f938b-554c-4bcb-9f4e-33c8be39eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1764506115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9db2b0b-75d1-4c5d-b0df-fdcbb681b756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab4121bb72e40d0ac54bac98289445a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:22Z,use_quota=True,user_id='713e855c579b430488395e2dc46cd820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47141936-397f-4512-a84a-45ebd0db718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47141936-397f-4512-a84a-45ebd0db718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f13e710-87ba-48c7-828d-6ffa93e56aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f13e710-87ba-48c7-828d-6ffa93e56aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9db2b0b-75d1-4c5d-b0df-fdcbb681b756', 'volume_name': 'volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a865504a-b121-4fd7-93a0-ec04d824121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a865504a-b121-4fd7-93a0-ec04d824121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037accaa-da09-4a6e-8149-bd6d74081415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Volume d9db2b0b-75d1-4c5d-b0df-fdcbb681b756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756', 'volume_size': 1} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1764506115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9db2b0b-75d1-4c5d-b0df-fdcbb681b756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab4121bb72e40d0ac54bac98289445a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:22Z,use_quota=True,user_id='713e855c579b430488395e2dc46cd820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Creating volume d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:22 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:22 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 1073741824 Nov 02 17:50:22 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:22 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 1073741824" returned: 0 in 0.687s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:22 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 Nov 02 17:50:22 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:23 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037accaa-da09-4a6e-8149-bd6d74081415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5585fee7-0b8b-4492-9720-d7034ed4ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:23 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Volume volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 (d9db2b0b-75d1-4c5d-b0df-fdcbb681b756): created successfully Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5585fee7-0b8b-4492-9720-d7034ed4ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Flow 'volume_create_manager' (3f3546d1-f3d5-4248-aee6-06df3533d278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a8a29b7a-4115-41b4-895b-fdb9dbaa0835 tempest-VolumesListAdminTestJSON-1435472307 None] Created volume successfully. Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Flow 'volume_create_manager' (5458807a-21aa-493c-80ff-0504c0e17ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43d7eba-fcdc-479f-8ea0-eb6410f01902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43d7eba-fcdc-479f-8ea0-eb6410f01902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-83781894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e62984-5771-4b45-90b2-0e6034064e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab4121bb72e40d0ac54bac98289445a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:24Z,use_quota=True,user_id='713e855c579b430488395e2dc46cd820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa654bb1-140d-4ba8-989f-246821b2da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa654bb1-140d-4ba8-989f-246821b2da08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcda789-4b79-41d6-a997-9333dfce9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdcda789-4b79-41d6-a997-9333dfce9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e62984-5771-4b45-90b2-0e6034064e0f', 'volume_name': 'volume-28e62984-5771-4b45-90b2-0e6034064e0f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec6a445-0f76-4451-8138-344f28080f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec6a445-0f76-4451-8138-344f28080f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec300a8-7b63-4080-842e-91b6611f4da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Volume 28e62984-5771-4b45-90b2-0e6034064e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e62984-5771-4b45-90b2-0e6034064e0f', 'volume_size': 1} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-83781894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e62984-5771-4b45-90b2-0e6034064e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab4121bb72e40d0ac54bac98289445a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:24Z,use_quota=True,user_id='713e855c579b430488395e2dc46cd820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Creating volume 28e62984-5771-4b45-90b2-0e6034064e0f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:24 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:24 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f 1073741824 Nov 02 17:50:24 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:25 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f 1073741824" returned: 0 in 0.544s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:25 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f Nov 02 17:50:25 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:25 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f" returned: 0 in 0.417s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec300a8-7b63-4080-842e-91b6611f4da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e62984-5771-4b45-90b2-0e6034064e0f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738153c9-1be3-4e5a-a8f6-30aed2dd0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Volume volume-28e62984-5771-4b45-90b2-0e6034064e0f (28e62984-5771-4b45-90b2-0e6034064e0f): created successfully Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (738153c9-1be3-4e5a-a8f6-30aed2dd0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Flow 'volume_create_manager' (5458807a-21aa-493c-80ff-0504c0e17ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a115281b-afcb-488a-8494-95ea4ca74327 tempest-VolumesListAdminTestJSON-1435472307 None] Created volume successfully. Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Flow 'volume_create_manager' (998740e5-f882-4cb3-8468-ca66484ce142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c67928f-4ff1-4fbe-8da1-e13d75b4903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c67928f-4ff1-4fbe-8da1-e13d75b4903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-890262126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4c4add-6373-42a0-b9d0-5a1783adbe88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efee1b585b554bac9383117867090e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:26Z,use_quota=True,user_id='bc84559ce3f24766a1db492c0ab6711f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bf6439-86e8-452f-b3d9-d959981b1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65bf6439-86e8-452f-b3d9-d959981b1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f3bfba-d18d-4eec-9007-6eb8b77d7c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f3bfba-d18d-4eec-9007-6eb8b77d7c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e4c4add-6373-42a0-b9d0-5a1783adbe88', 'volume_name': 'volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb385db-4e97-4045-bce5-834ebae23608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb385db-4e97-4045-bce5-834ebae23608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a77ef1-407b-495d-8474-d3b47f603662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Volume 8e4c4add-6373-42a0-b9d0-5a1783adbe88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88', 'volume_size': 1} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-890262126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e4c4add-6373-42a0-b9d0-5a1783adbe88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efee1b585b554bac9383117867090e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:26Z,use_quota=True,user_id='bc84559ce3f24766a1db492c0ab6711f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Creating volume 8e4c4add-6373-42a0-b9d0-5a1783adbe88 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:25 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:25 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 1073741824 Nov 02 17:50:25 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:26 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 1073741824" returned: 0 in 0.658s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:26 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 Nov 02 17:50:26 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:27 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88" returned: 0 in 0.524s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a77ef1-407b-495d-8474-d3b47f603662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e04ff6-0f7d-4041-bdbb-763957053616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Volume volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 (8e4c4add-6373-42a0-b9d0-5a1783adbe88): created successfully Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e04ff6-0f7d-4041-bdbb-763957053616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Flow 'volume_create_manager' (998740e5-f882-4cb3-8468-ca66484ce142) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0385b33d-bc44-43df-af05-887470e74cdb tempest-ServerActionsTestOtherA-313824487 None] Created volume successfully. Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Flow 'volume_create_manager' (96ada1f6-8d9c-444b-a64d-cc3805f3261b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94ec8d8-82c3-490a-9dad-9f134902f396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94ec8d8-82c3-490a-9dad-9f134902f396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-806729716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e062cd3f-8d04-40ef-aa97-7476a3f3452c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab4121bb72e40d0ac54bac98289445a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:28Z,use_quota=True,user_id='713e855c579b430488395e2dc46cd820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250054a2-043b-4e90-8280-d70df009715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (250054a2-043b-4e90-8280-d70df009715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832a4aa8-eb0b-43b5-962a-5cbd14224c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832a4aa8-eb0b-43b5-962a-5cbd14224c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e062cd3f-8d04-40ef-aa97-7476a3f3452c', 'volume_name': 'volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baab90b3-908c-4466-a0f4-e89d9bc4744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baab90b3-908c-4466-a0f4-e89d9bc4744f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25a4eb0-93b7-4c03-9bd1-ca9db99e9f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Volume e062cd3f-8d04-40ef-aa97-7476a3f3452c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c', 'volume_size': 1} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-806729716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e062cd3f-8d04-40ef-aa97-7476a3f3452c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab4121bb72e40d0ac54bac98289445a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:28Z,use_quota=True,user_id='713e855c579b430488395e2dc46cd820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Creating volume e062cd3f-8d04-40ef-aa97-7476a3f3452c {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:27 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c 1073741824 Nov 02 17:50:27 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:28 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c 1073741824" returned: 0 in 0.748s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:28 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c Nov 02 17:50:28 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:29 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c" returned: 0 in 0.429s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f25a4eb0-93b7-4c03-9bd1-ca9db99e9f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbdc8fc-4de1-49ae-89b7-2329e018fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Volume volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c (e062cd3f-8d04-40ef-aa97-7476a3f3452c): created successfully Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbdc8fc-4de1-49ae-89b7-2329e018fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Flow 'volume_create_manager' (96ada1f6-8d9c-444b-a64d-cc3805f3261b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a1b09fe0-762f-4f49-a594-7c01e2fa8e75 tempest-VolumesListAdminTestJSON-1435472307 None] Created volume successfully. Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Flow 'volume_create_manager' (0cc4f74b-30a7-4c22-8bf7-e1e520cf10e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd334681-c3ae-4fab-a43f-7c97bcab50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd334681-c3ae-4fab-a43f-7c97bcab50e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fced58-dfe4-4518-bbf6-e0724d97d4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2e4c0a31074b4fb58f30c297797daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:31Z,use_quota=True,user_id='be3728dbcef74523a375095098e0e014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1dc536-db9f-4e60-80c1-b13d72b7f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1dc536-db9f-4e60-80c1-b13d72b7f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad362d6c-1523-400d-8102-da228f0c7e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad362d6c-1523-400d-8102-da228f0c7e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fced58-dfe4-4518-bbf6-e0724d97d4ec', 'volume_name': 'volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3070fdbb-1db8-43ad-86ea-bb85628f2de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3070fdbb-1db8-43ad-86ea-bb85628f2de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c34183-58a8-4be8-8683-a5ff1ed339eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:31 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Volume 75fced58-dfe4-4518-bbf6-e0724d97d4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec', 'volume_size': 1} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fced58-dfe4-4518-bbf6-e0724d97d4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd2e4c0a31074b4fb58f30c297797daf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:31Z,use_quota=True,user_id='be3728dbcef74523a375095098e0e014',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Creating volume 75fced58-dfe4-4518-bbf6-e0724d97d4ec {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:31 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:31 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec 1073741824 Nov 02 17:50:31 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:32 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec 1073741824" returned: 0 in 0.836s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:32 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec Nov 02 17:50:32 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:32 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec" returned: 0 in 0.406s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c34183-58a8-4be8-8683-a5ff1ed339eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac99dd2-ebe3-4b1b-b851-186893a623d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:32 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Volume volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec (75fced58-dfe4-4518-bbf6-e0724d97d4ec): created successfully Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac99dd2-ebe3-4b1b-b851-186893a623d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Flow 'volume_create_manager' (0cc4f74b-30a7-4c22-8bf7-e1e520cf10e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-925ae6c0-4556-4f39-9db6-0dace257cb4d tempest-VolumesListAdminTestJSON-1329913534 None] Created volume successfully. Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Acquiring lock "cinder-75fced58-dfe4-4518-bbf6-e0724d97d4ec-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Lock "cinder-75fced58-dfe4-4518-bbf6-e0724d97d4ec-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Acquiring lock "cinder-quobyte-75fced58-dfe4-4518-bbf6-e0724d97d4ec" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Lock "cinder-quobyte-75fced58-dfe4-4518-bbf6-e0724d97d4ec" acquired by "delete_volume" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "cinder-e062cd3f-8d04-40ef-aa97-7476a3f3452c-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5df4d-932c-4d4b-a934-2fd2c69883eb]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-e062cd3f-8d04-40ef-aa97-7476a3f3452c-delete_volume" acquired by "delete_volume" :: waited 0.143s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "cinder-quobyte-e062cd3f-8d04-40ef-aa97-7476a3f3452c" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-quobyte-e062cd3f-8d04-40ef-aa97-7476a3f3452c" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:34 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec Nov 02 17:50:34 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d532931-ba77-4984-8b59-7ae455dc73ef]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:34 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c Nov 02 17:50:34 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:34 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec" returned: 0 in 0.838s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:34 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec Nov 02 17:50:34 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:34 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c" returned: 0 in 0.765s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:35 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c Nov 02 17:50:35 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:35 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-75fced58-dfe4-4518-bbf6-e0724d97d4ec" returned: 0 in 0.569s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Lock "cinder-quobyte-75fced58-dfe4-4518-bbf6-e0724d97d4ec" released by "delete_volume" :: held 1.539s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Created reservations ['c8adf638-146e-416d-93d5-a0580b250566', '5cd45ac0-3891-4eb3-832e-ff1254e8d7c8', '627331b0-a531-47e3-9829-2584c6770ace', 'a40ae400-ab7c-4710-b0dc-84cda6883dd4'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:35 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e062cd3f-8d04-40ef-aa97-7476a3f3452c" returned: 0 in 0.485s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-quobyte-e062cd3f-8d04-40ef-aa97-7476a3f3452c" released by "delete_volume" :: held 1.395s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Created reservations ['544d1ffa-08c1-41e0-99fc-7927d7ca2f3c', 'b6abb93f-ab02-4048-a734-c9fe2f923bc1', '88314df9-90b7-45fe-92c8-83ad634341b9', '57b12fe3-e629-49c2-87c9-a4e782213422'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:35 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:35 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:35 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:35 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:35 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.308s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:35 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Deleted volume successfully. Nov 02 17:50:35 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-99d2ce52-6160-4758-94a3-0130281264d2 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-e062cd3f-8d04-40ef-aa97-7476a3f3452c-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.533s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Deleted volume successfully. Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-edad463e-d9c7-4cb2-a467-53dbc098a27b tempest-VolumesListAdminTestJSON-1329913534 None] Lock "cinder-75fced58-dfe4-4518-bbf6-e0724d97d4ec-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "cinder-28e62984-5771-4b45-90b2-0e6034064e0f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-28e62984-5771-4b45-90b2-0e6034064e0f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "cinder-quobyte-28e62984-5771-4b45-90b2-0e6034064e0f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-quobyte-28e62984-5771-4b45-90b2-0e6034064e0f" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96fee3-314d-40d8-9b2b-5a3f979d5484]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:36 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f Nov 02 17:50:36 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:37 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f" returned: 0 in 0.605s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:37 devstack sudo[91551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f Nov 02 17:50:37 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:37 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28e62984-5771-4b45-90b2-0e6034064e0f" returned: 0 in 0.323s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-quobyte-28e62984-5771-4b45-90b2-0e6034064e0f" released by "delete_volume" :: held 0.975s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Created reservations ['427ad993-f1cd-4ab7-871c-a0a3b8e06141', '47550bc7-2ea8-4db2-a673-2c8971d7efab', 'e62b4e71-e1e8-49c6-b789-91693c5c73a6', '51753d86-ab6b-407e-b4e1-936163a2a3ac'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:37 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:37 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:37 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.308s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Deleted volume successfully. Nov 02 17:50:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-03673ebd-47ff-466e-a483-9ce56ddb9b35 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-28e62984-5771-4b45-90b2-0e6034064e0f-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "cinder-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "cinder-quobyte-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-quobyte-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:39 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29672ad-c2d5-423a-a9c5-2a600efdbc6c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:39 devstack sudo[91599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 Nov 02 17:50:39 devstack sudo[91599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:39 devstack sudo[91599]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756" returned: 0 in 0.838s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:40 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756 Nov 02 17:50:40 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:40 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756" returned: 0 in 0.542s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-quobyte-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756" released by "delete_volume" :: held 1.511s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Created reservations ['a85494be-b754-4947-a62a-2f555be41622', '3657c3aa-a8fa-44ef-b4a9-d7bf894dccd0', '71f8fb6c-5d18-49a0-a6ec-2faf3e6bdcd5', 'da9bc4e6-600f-4b0a-8dbe-209cbeca7c3c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:40 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:40 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:41 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Deleted volume successfully. Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67ffd950-a4a2-4ec7-a7a5-b8b8b99f5578 tempest-VolumesListAdminTestJSON-1435472307 None] Lock "cinder-d9db2b0b-75d1-4c5d-b0df-fdcbb681b756-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Flow 'volume_create_manager' (a02dbf1f-538a-453d-9ff0-1cf676a4cf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7016ab1-8a1f-48c1-ace6-d5267aac029d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7016ab1-8a1f-48c1-ace6-d5267aac029d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-611578967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca13909-c6f1-4564-b16c-7e0de854d43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034aad5d66ea433facd5a096e29ebad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:41Z,use_quota=True,user_id='40aee3ec728a483983499d8ca18e800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6812e1e9-2bd9-4475-808b-fb4a26177699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6812e1e9-2bd9-4475-808b-fb4a26177699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cded90-d177-45ba-affa-b496da33416a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3cded90-d177-45ba-affa-b496da33416a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ca13909-c6f1-4564-b16c-7e0de854d43f', 'volume_name': 'volume-9ca13909-c6f1-4564-b16c-7e0de854d43f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf59f49-3ba9-4a78-8768-31277020513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf59f49-3ba9-4a78-8768-31277020513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce88ff96-04c7-487f-b538-210f1a3e823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:41 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Volume 9ca13909-c6f1-4564-b16c-7e0de854d43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ca13909-c6f1-4564-b16c-7e0de854d43f', 'volume_size': 1} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-611578967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca13909-c6f1-4564-b16c-7e0de854d43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034aad5d66ea433facd5a096e29ebad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:41Z,use_quota=True,user_id='40aee3ec728a483983499d8ca18e800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Creating volume 9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:41 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:41 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f 1073741824 Nov 02 17:50:41 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:42 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f 1073741824" returned: 0 in 0.906s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:42 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f Nov 02 17:50:42 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:43 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f" returned: 0 in 0.502s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce88ff96-04c7-487f-b538-210f1a3e823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca13909-c6f1-4564-b16c-7e0de854d43f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cfc227-65bc-45a3-8af8-08085848b61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:43 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Volume volume-9ca13909-c6f1-4564-b16c-7e0de854d43f (9ca13909-c6f1-4564-b16c-7e0de854d43f): created successfully Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cfc227-65bc-45a3-8af8-08085848b61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Flow 'volume_create_manager' (a02dbf1f-538a-453d-9ff0-1cf676a4cf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b38cc9c9-1643-472a-bd9c-c523df982738 tempest-VolumesDeleteCascade-637338093 None] Created volume successfully. Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Creating offline snapshot eddfb7b5-bdd2-4ba3-9a24-75653224aed2 of volume 9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[084c0c46-581e-4995-a4b4-721098919137]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:43 devstack sudo[91633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f Nov 02 17:50:43 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:44 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f" returned: 0 in 0.489s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:44 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 1G Nov 02 17:50:44 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:44 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 1G" returned: 0 in 0.551s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca13909-c6f1-4564-b16c-7e0de854d43f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:44 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca13909-c6f1-4564-b16c-7e0de854d43f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:44 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:45 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca13909-c6f1-4564-b16c-7e0de854d43f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.378s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:45 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 is being set with open permissions: ugo+rw Nov 02 17:50:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:45 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:45 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:45 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:45 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info Nov 02 17:50:45 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:45 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:45 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info is being set with open permissions: ugo+rw Nov 02 17:50:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:45 devstack sudo[91658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info Nov 02 17:50:45 devstack sudo[91658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:46 devstack sudo[91658]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.info" returned: 0 in 0.252s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:46 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-77b36675-d97e-4ad1-a829-3ae308aa2683 tempest-VolumesDeleteCascade-637338093 None] Create snapshot completed successfully Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:46 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:46 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:46 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 8 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:50:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Creating offline snapshot 5b91c211-c7ba-447d-b25f-27ead7770630 of volume 9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1107e98-6b77-43f1-ba56-0b036572b404]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:47 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:47 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:47 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.394s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca13909-c6f1-4564-b16c-7e0de854d43f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:50:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:47 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 1G Nov 02 17:50:47 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:48 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 1G" returned: 0 in 0.491s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:48 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 Nov 02 17:50:48 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Flow 'volume_create_manager' (ce3b01ab-4ede-46ca-a842-021d223abc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779054af-63cf-448b-88bc-499dee0cfb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779054af-63cf-448b-88bc-499dee0cfb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-98052394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafe6166-7b20-465e-a6de-1552f5d108a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa9b53aa64744259b0a3578c7dbd9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:48Z,use_quota=True,user_id='c89345ab02f04bbdb0521fd4746f9443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e56756-91a7-45d1-a02e-90e314e030a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e56756-91a7-45d1-a02e-90e314e030a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095c901-6511-49f8-adb7-3c8b9252ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 17:50:48 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630" returned: 0 in 0.351s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:48 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 is being set with open permissions: ugo+rw Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:48 devstack sudo[91705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 Nov 02 17:50:48 devstack sudo[91705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:48 devstack sudo[91705]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630" returned: 0 in 0.250s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.592s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:48 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cb7cb17b-1abe-440e-91d7-6ad86cf6d422 tempest-VolumesDeleteCascade-637338093 None] Create snapshot completed successfully Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6095c901-6511-49f8-adb7-3c8b9252ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aafe6166-7b20-465e-a6de-1552f5d108a6', 'volume_name': 'volume-aafe6166-7b20-465e-a6de-1552f5d108a6', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6ace4f-a555-4d1b-a1d1-0fc2a32674b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6ace4f-a555-4d1b-a1d1-0fc2a32674b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792a8bf1-3dba-4a83-90aa-37227babbdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:48 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Volume aafe6166-7b20-465e-a6de-1552f5d108a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aafe6166-7b20-465e-a6de-1552f5d108a6', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 17:50:48 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Trying to clone aafe6166-7b20-465e-a6de-1552f5d108a6 from image 789043a6-2392-4529-ac6f-09077d7c12df at location (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 17:50:49 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Image download 20.69 MB at 20.69 MB/s Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5573e7-e42c-4121-a53f-d544af18b0a6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-9ca13909-c6f1-4564-b16c-7e0de854d43f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-9ca13909-c6f1-4564-b16c-7e0de854d43f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Performing cascade delete. {{(pid=86585) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-5b91c211-c7ba-447d-b25f-27ead7770630-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:49 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD Nov 02 17:50:49 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-5b91c211-c7ba-447d-b25f-27ead7770630-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-5b91c211-c7ba-447d-b25f-27ead7770630" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-5b91c211-c7ba-447d-b25f-27ead7770630" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Deleting offline snapshot 5b91c211-c7ba-447d-b25f-27ead7770630 of volume 9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] snapshot_file for this snap is: volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[565ad661-cd2f-43ae-9178-41400afbc5ec]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:49 devstack sudo[91731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 Nov 02 17:50:49 devstack sudo[91731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:49 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df is fetched for user c89345ab02f04bbdb0521fd4746f9443. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c915f3-5927-4b8b-903e-fc59f3ce9c0d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:49 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD Nov 02 17:50:49 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:50 devstack sudo[91731]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630" returned: 0 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca13909-c6f1-4564-b16c-7e0de854d43f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b6324-31b1-4a41-a4ad-5319fed05be9]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:50 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:50 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:50 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-98052394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafe6166-7b20-465e-a6de-1552f5d108a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6aa9b53aa64744259b0a3578c7dbd9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:48Z,use_quota=True,user_id='c89345ab02f04bbdb0521fd4746f9443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Creating volume aafe6166-7b20-465e-a6de-1552f5d108a6 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:50 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:50 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 1073741824 Nov 02 17:50:50 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:50 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.391s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca13909-c6f1-4564-b16c-7e0de854d43f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:50 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 Nov 02 17:50:50 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:50 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 1073741824" returned: 0 in 0.568s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:50 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 Nov 02 17:50:50 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:50 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630" returned: 0 in 0.514s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:51 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630 Nov 02 17:50:51 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:51 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Attempting download of 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume aafe6166-7b20-465e-a6de-1552f5d108a6. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb68ff7-fe27-459f-ac03-3b999fbe4284]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:51 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.5b91c211-c7ba-447d-b25f-27ead7770630" returned: 0 in 0.340s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-5b91c211-c7ba-447d-b25f-27ead7770630" released by "_delete_snapshot" :: held 1.764s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" released by "delete_snapshot" :: held 1.789s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:51 devstack sudo[91766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl Nov 02 17:50:51 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Created reservations ['55c615f9-7834-4528-a78d-02e23eaa6df0', '9513c5f3-ed42-4570-8622-4f8359f31968', 'b541bc78-f2d3-4f81-bbad-9d921aa16606', 'c21fd325-17bb-4f70-9af5-96629755e316'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Delete snapshot completed successfully. Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-5b91c211-c7ba-447d-b25f-27ead7770630-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-eddfb7b5-bdd2-4ba3-9a24-75653224aed2-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-eddfb7b5-bdd2-4ba3-9a24-75653224aed2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-eddfb7b5-bdd2-4ba3-9a24-75653224aed2" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-eddfb7b5-bdd2-4ba3-9a24-75653224aed2" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Deleting offline snapshot eddfb7b5-bdd2-4ba3-9a24-75653224aed2 of volume 9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] snapshot_file for this snap is: volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1bdd73-3222-4025-a2a2-bc75ae7e617e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:51 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl" returned: 0 in 0.489s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:51 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl Nov 02 17:50:51 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:51 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:51 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:52 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.503s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ca13909-c6f1-4564-b16c-7e0de854d43f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4997fc6-e941-47d7-a291-922e5a9c7bbe]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:52 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl" returned: 1 in 0.644s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_dfxlnpcl' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb8c873-96be-4163-93d1-76304c211222]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:52 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f Nov 02 17:50:52 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:52 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD Nov 02 17:50:52 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:52 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f" returned: 0 in 0.497s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:52 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:52 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:52 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] 789043a6-2392-4529-ac6f-09077d7c12df was qcow2, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:52 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-d7e37247-ab0c-4f14-ae5f-32cf0be07221 req-8c6172b7-577e-4e6b-b2d0-1363c1da32ce tempest-AttachVolumeTestJSON-713895963 None] Terminate volume connection completed successfully. Nov 02 17:50:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-d7e37247-ab0c-4f14-ae5f-32cf0be07221 req-8c6172b7-577e-4e6b-b2d0-1363c1da32ce tempest-AttachVolumeTestJSON-713895963 None] Deleting attachment e35af61e-4ccd-4f94-a383-c531ce0e7792. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:50:52 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 Nov 02 17:50:52 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:53 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.440s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:53 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2 Nov 02 17:50:53 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:53 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f.eddfb7b5-bdd2-4ba3-9a24-75653224aed2" returned: 0 in 0.313s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-eddfb7b5-bdd2-4ba3-9a24-75653224aed2" released by "_delete_snapshot" :: held 1.978s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" released by "delete_snapshot" :: held 2.042s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Created reservations ['985c2ea5-2a88-4ba4-9fe4-3b8025510ea4', 'c7e7472e-6728-4c6e-b483-08e80bf1d80e', '9f3f0274-7da7-4eb3-b4c6-675534068e67', 'c1200850-91e0-4992-947c-f0d95bcc7959'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Delete snapshot completed successfully. Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-eddfb7b5-bdd2-4ba3-9a24-75653224aed2-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Snapshots deleted, issuing volume delete {{(pid=86585) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7f953-8420-4f58-a840-9552889145e2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:54 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f Nov 02 17:50:54 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:54 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f" returned: 0 in 0.522s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:54 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f Nov 02 17:50:54 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:54 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9ca13909-c6f1-4564-b16c-7e0de854d43f" returned: 0 in 0.272s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-9ca13909-c6f1-4564-b16c-7e0de854d43f" released by "delete_volume" :: held 0.929s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:54 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Created reservations ['85624745-6c5c-4db3-86da-98e2bc3c0847', '2dfdf149-d94e-48a5-9203-882fbe966c98', 'bb526140-b8b0-4bd0-b061-9cb0211dee93', 'f0438487-72f2-4c15-aca7-246e4927f63b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:55 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:55 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:55 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6" returned: 0 in 2.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_nwgqi5d8devstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:50:55 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Converted 112.00 MB image at 48.76 MB/s Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:55 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 1G Nov 02 17:50:55 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:55 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.290s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Deleted volume successfully. Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-163ca274-4904-4718-907c-b3673a7fc4f0 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-9ca13909-c6f1-4564-b16c-7e0de854d43f-delete_volume" released by "delete_volume" :: held 5.892s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:55 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 1G" returned: 0 in 0.405s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Downloaded image 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume aafe6166-7b20-465e-a6de-1552f5d108a6 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df for user c89345ab02f04bbdb0521fd4746f9443 is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Marking volume aafe6166-7b20-465e-a6de-1552f5d108a6 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Copying metadata from image 789043a6-2392-4529-ac6f-09077d7c12df to aafe6166-7b20-465e-a6de-1552f5d108a6. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Creating volume glance metadata for volume aafe6166-7b20-465e-a6de-1552f5d108a6 backed by image 789043a6-2392-4529-ac6f-09077d7c12df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (792a8bf1-3dba-4a83-90aa-37227babbdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafe6166-7b20-465e-a6de-1552f5d108a6', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45afe9a4-f4aa-4838-9e52-8a2faf839450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:55 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Volume volume-aafe6166-7b20-465e-a6de-1552f5d108a6 (aafe6166-7b20-465e-a6de-1552f5d108a6): created successfully Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45afe9a4-f4aa-4838-9e52-8a2faf839450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Flow 'volume_create_manager' (ce3b01ab-4ede-46ca-a842-021d223abc0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-37c168dd-93d1-472d-abe3-177a6d678aa9 tempest-VolumesImageMetadata-79063747 None] Created volume successfully. Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Flow 'volume_create_manager' (74d33dd1-fe49-439d-ba6c-7e479aa53b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6772a4-b3a0-4dce-be50-d906fbc1c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d6772a4-b3a0-4dce-be50-d906fbc1c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-597709452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af607ce4-0769-4697-983d-ff1a8765793f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034aad5d66ea433facd5a096e29ebad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:56Z,use_quota=True,user_id='40aee3ec728a483983499d8ca18e800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d23f2-562e-436e-a2c9-58b9dfebe2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8d23f2-562e-436e-a2c9-58b9dfebe2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c46d9c7-165c-4b0a-b24c-b3d3a00340d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c46d9c7-165c-4b0a-b24c-b3d3a00340d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af607ce4-0769-4697-983d-ff1a8765793f', 'volume_name': 'volume-af607ce4-0769-4697-983d-ff1a8765793f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e57d337-d5fb-4b44-9ea6-29b720b4348a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e57d337-d5fb-4b44-9ea6-29b720b4348a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786edd27-fd76-4e7a-afdd-75b1b051ec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:56 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Volume af607ce4-0769-4697-983d-ff1a8765793f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af607ce4-0769-4697-983d-ff1a8765793f', 'volume_size': 1} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-597709452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af607ce4-0769-4697-983d-ff1a8765793f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034aad5d66ea433facd5a096e29ebad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:50:56Z,use_quota=True,user_id='40aee3ec728a483983499d8ca18e800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Creating volume af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:50:56 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:56 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f 1073741824 Nov 02 17:50:56 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Acquiring lock "cinder-aafe6166-7b20-465e-a6de-1552f5d108a6-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Lock "cinder-aafe6166-7b20-465e-a6de-1552f5d108a6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Acquiring lock "cinder-quobyte-aafe6166-7b20-465e-a6de-1552f5d108a6" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Lock "cinder-quobyte-aafe6166-7b20-465e-a6de-1552f5d108a6" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:50:56 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[15901e0b-ad73-4086-a8e5-757a5d8ca4fe]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f 1073741824" returned: 0 in 0.772s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:57 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f Nov 02 17:50:57 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:57 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 Nov 02 17:50:57 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:57 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f" returned: 0 in 0.382s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786edd27-fd76-4e7a-afdd-75b1b051ec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af607ce4-0769-4697-983d-ff1a8765793f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835f66ee-2c8d-4044-a948-43bb059fadba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:50:57 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Volume volume-af607ce4-0769-4697-983d-ff1a8765793f (af607ce4-0769-4697-983d-ff1a8765793f): created successfully Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (835f66ee-2c8d-4044-a948-43bb059fadba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Flow 'volume_create_manager' (74d33dd1-fe49-439d-ba6c-7e479aa53b52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:50:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca9ab005-d182-4262-a903-bb52e620b1f4 tempest-VolumesDeleteCascade-637338093 None] Created volume successfully. Nov 02 17:50:57 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6" returned: 0 in 0.634s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:57 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6 Nov 02 17:50:57 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:57 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-aafe6166-7b20-465e-a6de-1552f5d108a6" returned: 0 in 0.402s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Lock "cinder-quobyte-aafe6166-7b20-465e-a6de-1552f5d108a6" released by "delete_volume" :: held 1.138s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Created reservations ['e8db7f96-9107-47a0-b2c1-37bcead22e86', 'dcb03732-ebb5-43d2-9426-9888037eee24', 'cfaa4d32-5e4e-4f81-b3c9-bd22975cc43a', 'f2db155c-39a2-4e2e-90df-438ab0be356b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:58 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:50:58 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:50:58 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.471s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Creating offline snapshot efa85811-ba6c-4f50-bd6d-608edc0d61dc of volume af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:50:58 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Deleted volume successfully. Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff5be49-3bc3-4b7c-984b-ac8a684bb4f9]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a4e0c226-603f-4ea1-8d2d-69bdfb1e363d tempest-VolumesImageMetadata-79063747 None] Lock "cinder-aafe6166-7b20-465e-a6de-1552f5d108a6-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:50:58 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f Nov 02 17:50:58 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:59 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f" returned: 0 in 0.623s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:59 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc 1G Nov 02 17:50:59 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:50:59 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Nov 02 17:50:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc 1G" returned: 0 in 0.533s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:50:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af607ce4-0769-4697-983d-ff1a8765793f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:50:59 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af607ce4-0769-4697-983d-ff1a8765793f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc Nov 02 17:50:59 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:00 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af607ce4-0769-4697-983d-ff1a8765793f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc" returned: 0 in 0.369s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:00 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc is being set with open permissions: ugo+rw Nov 02 17:51:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:00 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc Nov 02 17:51:00 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:00 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:00 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info Nov 02 17:51:00 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:00 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info" returned: 0 in 0.341s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:00 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info is being set with open permissions: ugo+rw Nov 02 17:51:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:01 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info Nov 02 17:51:01 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:01 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.info" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c3416063-3f45-48b1-a872-9775fa89b886 tempest-VolumesDeleteCascade-637338093 None] Create snapshot completed successfully Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Flow 'volume_create_manager' (61eb42ca-b4a1-4e8e-84ed-051440283c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68565a6-422a-4634-a24d-1317941cd085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68565a6-422a-4634-a24d-1317941cd085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-495774517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=936e6d94-369a-4421-aeaa-1f24139bc173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='034aad5d66ea433facd5a096e29ebad1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efa85811-ba6c-4f50-bd6d-608edc0d61dc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:02Z,use_quota=True,user_id='40aee3ec728a483983499d8ca18e800c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9644b542-e692-4b48-8312-a8956c5b3255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9644b542-e692-4b48-8312-a8956c5b3255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48f7ced-87df-44ab-a1f0-d16f1e7080bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48f7ced-87df-44ab-a1f0-d16f1e7080bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '936e6d94-369a-4421-aeaa-1f24139bc173', 'volume_name': 'volume-936e6d94-369a-4421-aeaa-1f24139bc173', 'volume_size': 1, 'snapshot_id': 'efa85811-ba6c-4f50-bd6d-608edc0d61dc'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f683df7d-8682-4ead-8e1b-31c10eecbbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f683df7d-8682-4ead-8e1b-31c10eecbbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad52e2ff-c2e9-479b-bbef-76b6fa955404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Volume 936e6d94-369a-4421-aeaa-1f24139bc173: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-936e6d94-369a-4421-aeaa-1f24139bc173', 'volume_size': 1, 'snapshot_id': 'efa85811-ba6c-4f50-bd6d-608edc0d61dc'} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-efa85811-ba6c-4f50-bd6d-608edc0d61dc-936e6d94-369a-4421-aeaa-1f24139bc173" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-efa85811-ba6c-4f50-bd6d-608edc0d61dc-936e6d94-369a-4421-aeaa-1f24139bc173" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Creating volume 936e6d94-369a-4421-aeaa-1f24139bc173 from snapshot efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-936e6d94-369a-4421-aeaa-1f24139bc173" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-936e6d94-369a-4421-aeaa-1f24139bc173" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] snapshot: efa85811-ba6c-4f50-bd6d-608edc0d61dc, volume: 936e6d94-369a-4421-aeaa-1f24139bc173, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[561b0fde-d796-4793-b165-a79a486a3542]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:02 devstack sudo[92024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc Nov 02 17:51:02 devstack sudo[92024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:03 devstack sudo[92024]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc" returned: 0 in 0.424s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af607ce4-0769-4697-983d-ff1a8765793f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af59c0-9ce3-4369-97f1-9603c156a479]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:03 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f Nov 02 17:51:03 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:03 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f" returned: 0 in 0.394s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 17:51:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:03 devstack sudo[92036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 Nov 02 17:51:03 devstack sudo[92036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Flow 'volume_create_manager' (b996566c-3f51-4f47-ba86-0c28b416d2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b4d4d1-ad49-4302-bc10-da82d92fbbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b4d4d1-ad49-4302-bc10-da82d92fbbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1094208527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642e7730-f418-44c3-a0af-9a7f90f79ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1b5ffdcc524b1fb9c2a70165c3c84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:05Z,use_quota=True,user_id='f88d3662af8542578b0dc187bddc1c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b02f86a-8948-41d3-9099-ab9ebc7c8df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b02f86a-8948-41d3-9099-ab9ebc7c8df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceade8d-f7cb-43ef-b8d4-4ae902d8e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ceade8d-f7cb-43ef-b8d4-4ae902d8e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642e7730-f418-44c3-a0af-9a7f90f79ead', 'volume_name': 'volume-642e7730-f418-44c3-a0af-9a7f90f79ead', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a17e339-a8be-4228-9e8e-1f25f6edf94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a17e339-a8be-4228-9e8e-1f25f6edf94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3f35e8-c3f2-4b6d-afc1-98deff7fad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Volume 642e7730-f418-44c3-a0af-9a7f90f79ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642e7730-f418-44c3-a0af-9a7f90f79ead', 'volume_size': 1} Nov 02 17:51:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-fbe4a048-abe7-4afe-94be-63c4b27c8a51 req-a348660c-9874-4a88-a1d4-98f96f14f849 tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:12 devstack sudo[92036]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173" returned: 0 in 8.815s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f, size 1024.00 MB, duration 8.82 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:51:12 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Converted 1024.00 MB image at 116.15 MB/s Nov 02 17:51:12 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 is being set with open permissions: ugo+rw Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:12 devstack sudo[92123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 Nov 02 17:51:12 devstack sudo[92123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:12 devstack sudo[92123]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-936e6d94-369a-4421-aeaa-1f24139bc173" released by "_copy_volume_from_snapshot" :: held 10.009s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-efa85811-ba6c-4f50-bd6d-608edc0d61dc-936e6d94-369a-4421-aeaa-1f24139bc173" released by "_create_volume_from_snapshot" :: held 10.075s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.095s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.391s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1094208527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642e7730-f418-44c3-a0af-9a7f90f79ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1b5ffdcc524b1fb9c2a70165c3c84d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:05Z,use_quota=True,user_id='f88d3662af8542578b0dc187bddc1c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Creating volume 642e7730-f418-44c3-a0af-9a7f90f79ead {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:12 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:12 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead 1073741824 Nov 02 17:51:12 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad52e2ff-c2e9-479b-bbef-76b6fa955404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-936e6d94-369a-4421-aeaa-1f24139bc173', 'volume_size': 1, 'snapshot_id': 'efa85811-ba6c-4f50-bd6d-608edc0d61dc'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c7d1f4-c1d1-43b5-9e9e-c5f5420a870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:12 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Volume volume-936e6d94-369a-4421-aeaa-1f24139bc173 (936e6d94-369a-4421-aeaa-1f24139bc173): created successfully Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c7d1f4-c1d1-43b5-9e9e-c5f5420a870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Flow 'volume_create_manager' (61eb42ca-b4a1-4e8e-84ed-051440283c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d43b9bd1-8d46-47af-8ce8-f36ff1bc36ae tempest-VolumesDeleteCascade-637338093 None] Created volume successfully. Nov 02 17:51:13 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead 1073741824" returned: 0 in 0.429s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:13 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead Nov 02 17:51:13 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:13 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead" returned: 0 in 0.226s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-fbe4a048-abe7-4afe-94be-63c4b27c8a51 req-a348660c-9874-4a88-a1d4-98f96f14f849 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.805s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef3f35e8-c3f2-4b6d-afc1-98deff7fad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642e7730-f418-44c3-a0af-9a7f90f79ead', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27643247-f347-441b-94f4-ff4e42be7853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-fbe4a048-abe7-4afe-94be-63c4b27c8a51 req-a348660c-9874-4a88-a1d4-98f96f14f849 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Volume volume-642e7730-f418-44c3-a0af-9a7f90f79ead (642e7730-f418-44c3-a0af-9a7f90f79ead): created successfully Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27643247-f347-441b-94f4-ff4e42be7853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Flow 'volume_create_manager' (b996566c-3f51-4f47-ba86-0c28b416d2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-99ff605c-1177-4602-b534-c65336a6f79b tempest-AbsoluteLimitsTests-659008119 None] Created volume successfully. Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-fbe4a048-abe7-4afe-94be-63c4b27c8a51 req-a348660c-9874-4a88-a1d4-98f96f14f849 tempest-ServerActionsTestOtherA-313824487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12580a4c-b200-4c7d-b6c0-bf92a8ac118d', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:51:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-fbe4a048-abe7-4afe-94be-63c4b27c8a51 req-a348660c-9874-4a88-a1d4-98f96f14f849 tempest-ServerActionsTestOtherA-313824487 None] attachment_update completed successfully. Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-af607ce4-0769-4697-983d-ff1a8765793f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-af607ce4-0769-4697-983d-ff1a8765793f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Performing cascade delete. {{(pid=86585) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-efa85811-ba6c-4f50-bd6d-608edc0d61dc-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-efa85811-ba6c-4f50-bd6d-608edc0d61dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-af607ce4-0769-4697-983d-ff1a8765793f" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-af607ce4-0769-4697-983d-ff1a8765793f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-efa85811-ba6c-4f50-bd6d-608edc0d61dc" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-efa85811-ba6c-4f50-bd6d-608edc0d61dc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Deleting offline snapshot efa85811-ba6c-4f50-bd6d-608edc0d61dc of volume af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] snapshot_file for this snap is: volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d1b1df-a27e-42da-b1df-75c015844ba5]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:14 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc Nov 02 17:51:14 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:14 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc" returned: 0 in 0.439s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af607ce4-0769-4697-983d-ff1a8765793f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Acquiring lock "cinder-642e7730-f418-44c3-a0af-9a7f90f79ead-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06ac807-c25f-4540-9c7e-52b66e95d594]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Lock "cinder-642e7730-f418-44c3-a0af-9a7f90f79ead-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Acquiring lock "cinder-quobyte-642e7730-f418-44c3-a0af-9a7f90f79ead" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Lock "cinder-quobyte-642e7730-f418-44c3-a0af-9a7f90f79ead" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:14 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f Nov 02 17:51:14 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed5e36f-c853-446e-96ba-4a55762a2931]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:14 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead Nov 02 17:51:14 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:14 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead" returned: 0 in 0.396s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:15 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead Nov 02 17:51:15 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:15 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f" returned: 0 in 0.576s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:15 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc Nov 02 17:51:15 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:15 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642e7730-f418-44c3-a0af-9a7f90f79ead" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Lock "cinder-quobyte-642e7730-f418-44c3-a0af-9a7f90f79ead" released by "delete_volume" :: held 0.718s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Created reservations ['cfbb272c-1937-4229-a60d-eb965a2cf62b', '264d66b0-88e8-43bd-9bcf-b576394e0809', '78ed459f-dc7d-4574-bb49-12d536f59b12', 'eaf8cc85-daf4-4f07-86b2-34abb4c02005'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:15 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc" returned: 0 in 0.398s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:15 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:15 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:15 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc Nov 02 17:51:15 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:15 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.247s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Deleted volume successfully. Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-12488eaf-2902-4ecd-932d-1c1f6c4ee82d tempest-AbsoluteLimitsTests-659008119 None] Lock "cinder-642e7730-f418-44c3-a0af-9a7f90f79ead-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:15 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f.efa85811-ba6c-4f50-bd6d-608edc0d61dc" returned: 0 in 0.330s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-efa85811-ba6c-4f50-bd6d-608edc0d61dc" released by "_delete_snapshot" :: held 1.857s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-af607ce4-0769-4697-983d-ff1a8765793f" released by "delete_snapshot" :: held 1.885s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Created reservations ['45bcb398-bcc4-4ade-a3ae-ede66af815fa', '6b8e1b52-6406-489a-a7d3-e4e241166f2d', 'f281bf0e-3f85-41ee-a20e-5ef6cbe87dc3', '0b6f52c7-3cfe-4d7a-9c6c-308decc96662'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Delete snapshot completed successfully. Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-efa85811-ba6c-4f50-bd6d-608edc0d61dc-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Snapshots deleted, issuing volume delete {{(pid=86585) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-af607ce4-0769-4697-983d-ff1a8765793f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-af607ce4-0769-4697-983d-ff1a8765793f" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a82a1b-d318-4489-85b5-6d10ed4ff0ae]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:16 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f Nov 02 17:51:16 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:16 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f" returned: 0 in 0.450s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:16 devstack sudo[92590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f Nov 02 17:51:16 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:16 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af607ce4-0769-4697-983d-ff1a8765793f" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-af607ce4-0769-4697-983d-ff1a8765793f" released by "delete_volume" :: held 0.829s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Created reservations ['b467c160-c844-42f3-909b-db2d1e44a5bc', '80c2f2cf-b5b9-47f5-af34-86cb3039284f', '6eb32fbd-0cc9-47ea-a0ad-47191ee52fd2', 'b5bad38a-d378-4fc8-972d-3b77da6b1f5c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-57cd26c7-72a6-464e-9862-d0e1e5f61756 tempest-ServerActionsTestOtherA-313824487 None] Terminate volume connection completed successfully. Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-57cd26c7-72a6-464e-9862-d0e1e5f61756 tempest-ServerActionsTestOtherA-313824487 None] Deleting attachment 12580a4c-b200-4c7d-b6c0-bf92a8ac118d. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:17 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:17 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:17 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-936e6d94-369a-4421-aeaa-1f24139bc173-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.373s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Deleted volume successfully. Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-936e6d94-369a-4421-aeaa-1f24139bc173-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a3e3277-6eaa-49a5-9236-719a60190cf7 tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-af607ce4-0769-4697-983d-ff1a8765793f-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=123,cinder:INSERT=31,cinder:UPDATE=111,cinder:DELETE=11 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "cinder-quobyte-936e6d94-369a-4421-aeaa-1f24139bc173" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-936e6d94-369a-4421-aeaa-1f24139bc173" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[031baf7f-4073-416a-8cfa-af1e92c8a808]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:17 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 Nov 02 17:51:17 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-82744f1a-f57c-4863-ba8d-ca640d274d83 tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-82744f1a-f57c-4863-ba8d-ca640d274d83 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=134,cinder:DELETE=11,cinder:SELECT=103,cinder:INSERT=39 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:51:18 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173" returned: 0 in 0.549s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-82744f1a-f57c-4863-ba8d-ca640d274d83 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:18 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173 Nov 02 17:51:18 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-82744f1a-f57c-4863-ba8d-ca640d274d83 tempest-ServerActionsTestOtherA-313824487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d79c95b-ef9e-460f-a945-d077fc7b2f32', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:51:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-7ff1211c-af78-499b-8c0d-1b69041f196f req-82744f1a-f57c-4863-ba8d-ca640d274d83 tempest-ServerActionsTestOtherA-313824487 None] attachment_update completed successfully. Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-936e6d94-369a-4421-aeaa-1f24139bc173" returned: 0 in 0.329s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:18 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-quobyte-936e6d94-369a-4421-aeaa-1f24139bc173" released by "delete_volume" :: held 0.965s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Created reservations ['90bf2ee9-9eaf-4c10-a00d-becc06139191', '78cb1028-a02f-4b4d-91ce-1e81359115f8', 'cd4c8f4a-2192-4a0f-b531-0404da8c6d9c', '20adb7ad-d881-43e7-a1e3-b90ec3c07775'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:18 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:18 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:18 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.299s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Deleted volume successfully. Nov 02 17:51:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-85e8bd8f-7fb1-4fc2-820f-8a0caf13d33b tempest-VolumesDeleteCascade-637338093 None] Lock "cinder-936e6d94-369a-4421-aeaa-1f24139bc173-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Flow 'volume_create_manager' (d70d134d-9a0e-4a6b-9129-cd6a53fac7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975856e4-85fb-4875-ad23-e74635ec40e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975856e4-85fb-4875-ad23-e74635ec40e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-403287725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d49b8eb73d47d78220db0a6fbd34e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:24Z,use_quota=True,user_id='5b07d3c6b5f54f44ae5fbdad561dca4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6cf58c-3463-435a-9808-61c7e69cb61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6cf58c-3463-435a-9808-61c7e69cb61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06b746d-6919-475e-a312-b0b7f43c267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06b746d-6919-475e-a312-b0b7f43c267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9', 'volume_name': 'volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edaefb4-479a-445f-8b43-fc088d7d0923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edaefb4-479a-445f-8b43-fc088d7d0923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5776f725-e70c-4834-a632-4dcacab658e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Volume 0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9', 'volume_size': 1} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-403287725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d49b8eb73d47d78220db0a6fbd34e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:24Z,use_quota=True,user_id='5b07d3c6b5f54f44ae5fbdad561dca4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Creating volume 0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:24 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:24 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 1073741824 Nov 02 17:51:24 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:25 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 1073741824" returned: 0 in 0.877s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:25 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 Nov 02 17:51:25 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:25 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9" returned: 0 in 0.383s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5776f725-e70c-4834-a632-4dcacab658e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52630bbc-0317-494d-8c26-c3cc35a70fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Volume volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 (0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9): created successfully Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52630bbc-0317-494d-8c26-c3cc35a70fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Flow 'volume_create_manager' (d70d134d-9a0e-4a6b-9129-cd6a53fac7c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f4247ac8-2dbd-4b6e-8cd4-48cd9e149610 tempest-VolumesListTestJSON-261527182 None] Created volume successfully. Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Flow 'volume_create_manager' (be754094-930b-4516-adea-a215e02e1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34793cbb-ec33-4f8c-8338-a8b5af7307b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34793cbb-ec33-4f8c-8338-a8b5af7307b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1369898161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a44dea8-2714-4bfa-9522-a60ff67302db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d49b8eb73d47d78220db0a6fbd34e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:27Z,use_quota=True,user_id='5b07d3c6b5f54f44ae5fbdad561dca4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc588a3-00bf-423d-965a-d79f0019092d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc588a3-00bf-423d-965a-d79f0019092d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d84bd88-4bb1-4f02-8d6a-a1c92db6fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d84bd88-4bb1-4f02-8d6a-a1c92db6fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a44dea8-2714-4bfa-9522-a60ff67302db', 'volume_name': 'volume-4a44dea8-2714-4bfa-9522-a60ff67302db', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f112e-7077-4a33-b182-85e8f3c0ff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873f112e-7077-4a33-b182-85e8f3c0ff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528121a3-ece0-4cb3-8447-b37d738ba328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Volume 4a44dea8-2714-4bfa-9522-a60ff67302db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a44dea8-2714-4bfa-9522-a60ff67302db', 'volume_size': 1} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1369898161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a44dea8-2714-4bfa-9522-a60ff67302db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d49b8eb73d47d78220db0a6fbd34e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:27Z,use_quota=True,user_id='5b07d3c6b5f54f44ae5fbdad561dca4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Creating volume 4a44dea8-2714-4bfa-9522-a60ff67302db {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:27 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db 1073741824 Nov 02 17:51:27 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Flow 'volume_create_manager' (4d4b30d0-c19d-4bb7-97df-8a38f8a2fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75718ed4-4540-425b-bfd8-7cf569387422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75718ed4-4540-425b-bfd8-7cf569387422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2086453240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7955c17a-d8a5-4190-a48b-4645114104ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d83fbb4ba84a0c83796b6e92f96181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:27Z,use_quota=True,user_id='1adf64c03e414b7287a96cfe93150607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e718906d-e8b3-4077-9f26-0b527229144f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e718906d-e8b3-4077-9f26-0b527229144f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fbb442-8f1b-4b28-bf22-179f9f5175f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fbb442-8f1b-4b28-bf22-179f9f5175f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7955c17a-d8a5-4190-a48b-4645114104ef', 'volume_name': 'volume-7955c17a-d8a5-4190-a48b-4645114104ef', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf4472f-c5bd-4fde-bf83-791761438cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bf4472f-c5bd-4fde-bf83-791761438cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617130d6-9fc4-4477-b676-1f8751445419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Volume 7955c17a-d8a5-4190-a48b-4645114104ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7955c17a-d8a5-4190-a48b-4645114104ef', 'volume_size': 1} Nov 02 17:51:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:28 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db 1073741824" returned: 0 in 0.543s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:28 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db Nov 02 17:51:28 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:28 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2086453240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7955c17a-d8a5-4190-a48b-4645114104ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d83fbb4ba84a0c83796b6e92f96181',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:27Z,use_quota=True,user_id='1adf64c03e414b7287a96cfe93150607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Creating volume 7955c17a-d8a5-4190-a48b-4645114104ef {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:28 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (528121a3-ece0-4cb3-8447-b37d738ba328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a44dea8-2714-4bfa-9522-a60ff67302db', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1eb4bb-1643-4b5b-908c-d7637f3cd975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:28 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef 1073741824 Nov 02 17:51:28 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Volume volume-4a44dea8-2714-4bfa-9522-a60ff67302db (4a44dea8-2714-4bfa-9522-a60ff67302db): created successfully Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1eb4bb-1643-4b5b-908c-d7637f3cd975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Flow 'volume_create_manager' (be754094-930b-4516-adea-a215e02e1435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6f92baf7-afbe-402e-ae6f-8518aad859be tempest-VolumesListTestJSON-261527182 None] Created volume successfully. Nov 02 17:51:28 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef 1073741824" returned: 0 in 0.501s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:29 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef Nov 02 17:51:29 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:29 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef" returned: 0 in 0.284s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617130d6-9fc4-4477-b676-1f8751445419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7955c17a-d8a5-4190-a48b-4645114104ef', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a36b8f8-8461-4a71-ae50-b08db31ea0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Volume volume-7955c17a-d8a5-4190-a48b-4645114104ef (7955c17a-d8a5-4190-a48b-4645114104ef): created successfully Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a36b8f8-8461-4a71-ae50-b08db31ea0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Flow 'volume_create_manager' (4d4b30d0-c19d-4bb7-97df-8a38f8a2fde1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f166ae5a-4fe7-4797-b0b2-2c6ccfe3f8d3 tempest-VolumesMetadataTest-597609116 None] Created volume successfully. Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Flow 'volume_create_manager' (d1c47642-f9ab-4e89-86e2-c405af4277dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9245e05f-5c7a-4454-a810-69414fdbf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9245e05f-5c7a-4454-a810-69414fdbf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025101615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70827f1-29a2-47c3-b893-a27a05e3509a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d49b8eb73d47d78220db0a6fbd34e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:30Z,use_quota=True,user_id='5b07d3c6b5f54f44ae5fbdad561dca4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda4b04f-ccc2-46df-87b9-7ae1abc6bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda4b04f-ccc2-46df-87b9-7ae1abc6bda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c84d060-f050-44f7-af44-73cf989446d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c84d060-f050-44f7-af44-73cf989446d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70827f1-29a2-47c3-b893-a27a05e3509a', 'volume_name': 'volume-f70827f1-29a2-47c3-b893-a27a05e3509a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18ad479-6cd2-4257-854d-3da9ab3e7550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18ad479-6cd2-4257-854d-3da9ab3e7550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe708c8-e544-4b44-a7be-25803e40349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Volume f70827f1-29a2-47c3-b893-a27a05e3509a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70827f1-29a2-47c3-b893-a27a05e3509a', 'volume_size': 1} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025101615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70827f1-29a2-47c3-b893-a27a05e3509a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b9d49b8eb73d47d78220db0a6fbd34e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:30Z,use_quota=True,user_id='5b07d3c6b5f54f44ae5fbdad561dca4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Creating volume f70827f1-29a2-47c3-b893-a27a05e3509a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:30 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:30 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a 1073741824 Nov 02 17:51:30 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:31 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a 1073741824" returned: 0 in 0.677s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:31 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a Nov 02 17:51:31 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:31 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fe708c8-e544-4b44-a7be-25803e40349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70827f1-29a2-47c3-b893-a27a05e3509a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b48c2d-cd2a-4a45-8e5a-313696d97432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:31 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Volume volume-f70827f1-29a2-47c3-b893-a27a05e3509a (f70827f1-29a2-47c3-b893-a27a05e3509a): created successfully Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b48c2d-cd2a-4a45-8e5a-313696d97432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Flow 'volume_create_manager' (d1c47642-f9ab-4e89-86e2-c405af4277dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ee250d90-1358-4b73-b979-88560c62545d tempest-VolumesListTestJSON-261527182 None] Created volume successfully. Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Acquiring lock "cinder-7955c17a-d8a5-4190-a48b-4645114104ef-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Lock "cinder-7955c17a-d8a5-4190-a48b-4645114104ef-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Acquiring lock "cinder-quobyte-7955c17a-d8a5-4190-a48b-4645114104ef" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Lock "cinder-quobyte-7955c17a-d8a5-4190-a48b-4645114104ef" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e3325-3e5a-475c-8144-1e8afd91cf58]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:31 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef Nov 02 17:51:31 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:32 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef" returned: 0 in 0.511s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:32 devstack sudo[93228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef Nov 02 17:51:32 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:32 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7955c17a-d8a5-4190-a48b-4645114104ef" returned: 0 in 0.504s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Lock "cinder-quobyte-7955c17a-d8a5-4190-a48b-4645114104ef" released by "delete_volume" :: held 1.086s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Created reservations ['3be5d62d-388e-46e8-b465-163d078cb20f', '2060fa95-a31e-498f-8a90-268aca33303e', '42873b86-f821-40c7-a1e8-bf69bbbe003b', '7f8c39ae-ba9d-466b-bccd-b1419f17af51'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:33 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:33 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:33 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.442s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:33 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Deleted volume successfully. Nov 02 17:51:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-de2780d7-8fe6-400d-b17b-841ac3d218c1 tempest-VolumesMetadataTest-597609116 None] Lock "cinder-7955c17a-d8a5-4190-a48b-4645114104ef-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "cinder-f70827f1-29a2-47c3-b893-a27a05e3509a-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-f70827f1-29a2-47c3-b893-a27a05e3509a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "cinder-quobyte-f70827f1-29a2-47c3-b893-a27a05e3509a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-quobyte-f70827f1-29a2-47c3-b893-a27a05e3509a" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ee96af-be4c-4dd5-93e0-e3407fc969a6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:36 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a Nov 02 17:51:36 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:36 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a" returned: 0 in 0.540s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:36 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a Nov 02 17:51:36 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:37 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f70827f1-29a2-47c3-b893-a27a05e3509a" returned: 0 in 0.498s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-quobyte-f70827f1-29a2-47c3-b893-a27a05e3509a" released by "delete_volume" :: held 1.101s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Created reservations ['c8657751-9650-4247-addd-acb646154171', '21025f03-c695-49a0-aa9b-d0bb76f623c5', '17781387-c6cf-4f62-9789-2a8a2f4baa9f', 'a01da612-b938-4fa8-a9b1-e06249eaf9ad'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:37 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:37 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:37 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.457s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Deleted volume successfully. Nov 02 17:51:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-24b79566-40b9-4cd6-9f6f-910da2841d81 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-f70827f1-29a2-47c3-b893-a27a05e3509a-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Acquiring lock "cinder-4a44dea8-2714-4bfa-9522-a60ff67302db-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Lock "cinder-4a44dea8-2714-4bfa-9522-a60ff67302db-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Acquiring lock "cinder-quobyte-4a44dea8-2714-4bfa-9522-a60ff67302db" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Lock "cinder-quobyte-4a44dea8-2714-4bfa-9522-a60ff67302db" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e63dcbe-04c7-473c-9b81-e96337cfa9f6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:38 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db Nov 02 17:51:38 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:39 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db" returned: 0 in 0.386s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:39 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db Nov 02 17:51:39 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:39 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a44dea8-2714-4bfa-9522-a60ff67302db" returned: 0 in 0.291s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Lock "cinder-quobyte-4a44dea8-2714-4bfa-9522-a60ff67302db" released by "delete_volume" :: held 0.730s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Created reservations ['1181f1c3-33c3-4b16-9ca7-d24429c8c1c3', '43f2093b-6ff1-41aa-9c46-5f9ed5583d06', 'd67da548-82f2-4c53-aa1e-5aab12e1b3a0', '8540b634-1263-413b-a930-d6983f349d4e'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:39 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:39 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "cinder-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "cinder-quobyte-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-quobyte-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:40 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.547s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a09cea-dbf4-4090-8d8a-4cc0bc36d071]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Deleted volume successfully. Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7b2619bc-8ed4-409b-b381-828dbd5bc04d tempest-VolumesListTestJSON-261527182 None] Lock "cinder-4a44dea8-2714-4bfa-9522-a60ff67302db-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:40 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 Nov 02 17:51:40 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:40 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9" returned: 0 in 0.580s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:40 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9 Nov 02 17:51:40 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:41 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9" returned: 0 in 0.322s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-quobyte-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9" released by "delete_volume" :: held 1.002s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Created reservations ['7e89decf-28af-4a5f-a39b-147e89fc4ecb', 'bbd78c0e-ca30-47f8-b690-19eb0b38fdc1', '8f7b18b5-3113-4c59-a69d-15c95050223e', 'fd13b7ec-76d3-4cd3-8df0-7a3106bf3ed6'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:41 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:41 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Flow 'volume_create_manager' (de8a4966-b020-4c9f-a6c6-5a7fbfd2d1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea766129-d996-48df-98a7-2b6503ad6fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea766129-d996-48df-98a7-2b6503ad6fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1310387165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759703ea-01a5-4e88-a1cd-51eadef9b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e18dd62f940daa2b462eb815976ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:41Z,use_quota=True,user_id='160fc733e19148f1af67d6df0a010395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008577ff-aec1-4eef-b1f1-c66417ad574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008577ff-aec1-4eef-b1f1-c66417ad574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39917df5-1521-407b-b85f-838e8793121c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39917df5-1521-407b-b85f-838e8793121c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759703ea-01a5-4e88-a1cd-51eadef9b118', 'volume_name': 'volume-759703ea-01a5-4e88-a1cd-51eadef9b118', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52dbba7-c5ee-4538-a3ee-5ab0c4cbb43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52dbba7-c5ee-4538-a3ee-5ab0c4cbb43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dabe524-d78c-4316-b150-a36f2e4e8965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:41 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Volume 759703ea-01a5-4e88-a1cd-51eadef9b118: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759703ea-01a5-4e88-a1cd-51eadef9b118', 'volume_size': 1} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1310387165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759703ea-01a5-4e88-a1cd-51eadef9b118,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e18dd62f940daa2b462eb815976ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:41Z,use_quota=True,user_id='160fc733e19148f1af67d6df0a010395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Creating volume 759703ea-01a5-4e88-a1cd-51eadef9b118 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:41 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:41 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 1073741824 Nov 02 17:51:41 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:41 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Deleted volume successfully. Nov 02 17:51:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-288a15c5-0b56-4856-97a4-7c48c8c49220 tempest-VolumesListTestJSON-261527182 None] Lock "cinder-0ba62ed8-b9a0-4eb0-8900-4edaaed3b6f9-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:42 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 1073741824" returned: 0 in 0.597s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:42 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 Nov 02 17:51:42 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:42 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dabe524-d78c-4316-b150-a36f2e4e8965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759703ea-01a5-4e88-a1cd-51eadef9b118', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afd8c16-8891-4e8a-ab23-3287bbeabc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:42 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Volume volume-759703ea-01a5-4e88-a1cd-51eadef9b118 (759703ea-01a5-4e88-a1cd-51eadef9b118): created successfully Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afd8c16-8891-4e8a-ab23-3287bbeabc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Flow 'volume_create_manager' (de8a4966-b020-4c9f-a6c6-5a7fbfd2d1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:42 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b4aaa28d-f69b-45e6-a2d2-372bf7e96225 tempest-VolumesTransfersV357Test-612173189 None] Created volume successfully. Nov 02 17:51:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c03aff35-5d11-4961-8181-6890f556cbb2 tempest-VolumesTransfersV357Test-1604535086 None] Transfer volume completed successfully. Nov 02 17:51:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Acquiring lock "cinder-759703ea-01a5-4e88-a1cd-51eadef9b118-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-759703ea-01a5-4e88-a1cd-51eadef9b118-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Acquiring lock "cinder-quobyte-759703ea-01a5-4e88-a1cd-51eadef9b118" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-quobyte-759703ea-01a5-4e88-a1cd-51eadef9b118" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:45 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8097ff5d-86b8-4228-8dbc-ce336dbf7708]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:45 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 Nov 02 17:51:45 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:46 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118" returned: 0 in 0.518s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:46 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118 Nov 02 17:51:46 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:46 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-759703ea-01a5-4e88-a1cd-51eadef9b118" returned: 0 in 0.372s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-quobyte-759703ea-01a5-4e88-a1cd-51eadef9b118" released by "delete_volume" :: held 0.973s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:46 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:46 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Created reservations ['0fb6da0e-5a8f-401f-aaa6-e9e959029b24', '3cd41ea5-fff4-4d31-a5f8-027b1c968b59', 'db8ca0a0-af27-42f2-9a66-d470c3bb03c0', '0ba9d002-7411-476b-8ae3-190b7ed0cdd5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:46 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:46 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:46 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.388s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:51:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:51:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-bf38d7eb-9854-44c5-aa53-5fb235c650f7 req-9ac2bf6c-e85d-4796-b49b-18c5618620d2 tempest-ServerActionsTestOtherA-313824487 None] Terminate volume connection completed successfully. Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-bf38d7eb-9854-44c5-aa53-5fb235c650f7 req-9ac2bf6c-e85d-4796-b49b-18c5618620d2 tempest-ServerActionsTestOtherA-313824487 None] Deleting attachment 0d79c95b-ef9e-460f-a945-d077fc7b2f32. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:51:47 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.433s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Deleted volume successfully. Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-51558a1b-30a8-4d19-ad68-3d3c24a2f1a5 tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-759703ea-01a5-4e88-a1cd-51eadef9b118-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Flow 'volume_create_manager' (cdd2e22f-8a04-4ceb-8690-bb1614285eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63eb6b49-c536-4004-aad6-a18d412f917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63eb6b49-c536-4004-aad6-a18d412f917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1551982899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53b3841-8314-4b51-b483-ecaeef81d535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1703187eea4217a1e67c47865161fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:47Z,use_quota=True,user_id='c94c76fe357947f4b4aa780008c21068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84901c0c-1f9f-413d-829e-b3645141468c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84901c0c-1f9f-413d-829e-b3645141468c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af42d0dd-bb84-4bb9-9c94-2815c4aefc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af42d0dd-bb84-4bb9-9c94-2815c4aefc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b53b3841-8314-4b51-b483-ecaeef81d535', 'volume_name': 'volume-b53b3841-8314-4b51-b483-ecaeef81d535', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b576b62-251a-42cf-974b-755fbb9040f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b576b62-251a-42cf-974b-755fbb9040f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c936ee74-6360-4634-9fa2-aedc3a3985ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:47 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Volume b53b3841-8314-4b51-b483-ecaeef81d535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b53b3841-8314-4b51-b483-ecaeef81d535', 'volume_size': 1} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1551982899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53b3841-8314-4b51-b483-ecaeef81d535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1703187eea4217a1e67c47865161fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:47Z,use_quota=True,user_id='c94c76fe357947f4b4aa780008c21068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Creating volume b53b3841-8314-4b51-b483-ecaeef81d535 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:47 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:47 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 1073741824 Nov 02 17:51:47 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:48 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 1073741824" returned: 0 in 0.667s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:48 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 Nov 02 17:51:48 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Flow 'volume_create_manager' (2f4cd718-904e-48d3-bb94-add4b69af71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29903bc-8d69-4194-b5e1-4781b6e95d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29903bc-8d69-4194-b5e1-4781b6e95d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1196788808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db1575-c6af-4b4b-bf76-d649c8e0beb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e18dd62f940daa2b462eb815976ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:49Z,use_quota=True,user_id='160fc733e19148f1af67d6df0a010395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6e2caf-09f2-4d9f-ab92-db5377afdd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab6e2caf-09f2-4d9f-ab92-db5377afdd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207af011-7ede-4817-bb28-3b4d3e5b45e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207af011-7ede-4817-bb28-3b4d3e5b45e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9db1575-c6af-4b4b-bf76-d649c8e0beb8', 'volume_name': 'volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceac1d1-3bc0-4a46-b3f9-2c3ed0fb5765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceac1d1-3bc0-4a46-b3f9-2c3ed0fb5765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90dc4c27-b599-4c68-b7cb-e8e09a025485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:48 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Volume f9db1575-c6af-4b4b-bf76-d649c8e0beb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8', 'volume_size': 1} Nov 02 17:51:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:49 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535" returned: 0 in 0.654s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1196788808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9db1575-c6af-4b4b-bf76-d649c8e0beb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e18dd62f940daa2b462eb815976ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:49Z,use_quota=True,user_id='160fc733e19148f1af67d6df0a010395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Creating volume f9db1575-c6af-4b4b-bf76-d649c8e0beb8 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:49 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c936ee74-6360-4634-9fa2-aedc3a3985ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53b3841-8314-4b51-b483-ecaeef81d535', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:49 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 1073741824 Nov 02 17:51:49 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7319515-071d-4984-b75a-81ddfd668a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:49 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Volume volume-b53b3841-8314-4b51-b483-ecaeef81d535 (b53b3841-8314-4b51-b483-ecaeef81d535): created successfully Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7319515-071d-4984-b75a-81ddfd668a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Flow 'volume_create_manager' (cdd2e22f-8a04-4ceb-8690-bb1614285eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-40e180cf-79b6-4a05-b78b-8cd6bda116bc tempest-VolumesNegativeTest-454571863 None] Created volume successfully. Nov 02 17:51:49 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 1073741824" returned: 0 in 0.707s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:49 devstack sudo[93477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 Nov 02 17:51:49 devstack sudo[93477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:50 devstack sudo[93477]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8" returned: 0 in 0.282s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90dc4c27-b599-4c68-b7cb-e8e09a025485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c0fe93-17ad-414c-87a3-0dd39cd8a404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:50 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Volume volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 (f9db1575-c6af-4b4b-bf76-d649c8e0beb8): created successfully Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c0fe93-17ad-414c-87a3-0dd39cd8a404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Flow 'volume_create_manager' (2f4cd718-904e-48d3-bb94-add4b69af71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:50 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ec56ed8c-88bf-48a1-9b64-54cd0b2dca63 tempest-VolumesTransfersV357Test-612173189 None] Created volume successfully. Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Acquiring lock "cinder-f9db1575-c6af-4b4b-bf76-d649c8e0beb8-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-f9db1575-c6af-4b4b-bf76-d649c8e0beb8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Acquiring lock "cinder-quobyte-f9db1575-c6af-4b4b-bf76-d649c8e0beb8" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-quobyte-f9db1575-c6af-4b4b-bf76-d649c8e0beb8" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c7738f-4542-448a-a734-0287f9199750]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:51 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 Nov 02 17:51:51 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:51 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8" returned: 0 in 0.395s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:51 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8 Nov 02 17:51:51 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:52 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f9db1575-c6af-4b4b-bf76-d649c8e0beb8" returned: 0 in 0.260s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-quobyte-f9db1575-c6af-4b4b-bf76-d649c8e0beb8" released by "delete_volume" :: held 0.712s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Created reservations ['fdc5d991-7eaa-448b-9757-cd4d96f339a1', '4ab62049-cf39-471b-9338-57d0813bae8c', '90b211ee-51b5-413f-8e54-290d3dababfe', '1f87f63f-f10f-4c16-8871-313d7cb0407f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:52 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:51:52 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:52 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.427s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:51:52 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Deleted volume successfully. Nov 02 17:51:52 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5e5a6b58-abf3-480f-8f26-d6658bd9c35a tempest-VolumesTransfersV357Test-1442750382 None] Lock "cinder-f9db1575-c6af-4b4b-bf76-d649c8e0beb8-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Flow 'volume_create_manager' (70b47063-182b-481e-8f9c-47432902e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f64e98-d854-4139-a4a9-4869340235a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f64e98-d854-4139-a4a9-4869340235a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-392989231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609146eb-92de-4fe3-897f-91e94178b834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efee1b585b554bac9383117867090e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:55Z,use_quota=True,user_id='bc84559ce3f24766a1db492c0ab6711f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cf7dc8-35e7-4236-bac6-7e39a343e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58cf7dc8-35e7-4236-bac6-7e39a343e265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aae5e6d-411d-4bf8-a0bc-d8f1a37c2534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aae5e6d-411d-4bf8-a0bc-d8f1a37c2534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '609146eb-92de-4fe3-897f-91e94178b834', 'volume_name': 'volume-609146eb-92de-4fe3-897f-91e94178b834', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e13cdd-5d77-4093-afa5-e7d79b4c4014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e13cdd-5d77-4093-afa5-e7d79b4c4014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25243ebd-3bcc-4048-908d-7872c1f88d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:51:55 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Volume 609146eb-92de-4fe3-897f-91e94178b834: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-609146eb-92de-4fe3-897f-91e94178b834', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Trying to clone 609146eb-92de-4fe3-897f-91e94178b834 from image 789043a6-2392-4529-ac6f-09077d7c12df at location (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 17:51:55 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Image download 20.69 MB at 20.69 MB/s Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1187c871-57cd-49fc-9e66-9fd649bca246]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:56 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD Nov 02 17:51:56 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:56 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df is fetched for user bc84559ce3f24766a1db492c0ab6711f. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[32239da0-5cc5-417c-9ebb-a458cc892c53]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:56 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD Nov 02 17:51:56 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:56 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-392989231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609146eb-92de-4fe3-897f-91e94178b834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efee1b585b554bac9383117867090e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:51:55Z,use_quota=True,user_id='bc84559ce3f24766a1db492c0ab6711f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Creating volume 609146eb-92de-4fe3-897f-91e94178b834 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:51:56 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:51:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:56 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 1073741824 Nov 02 17:51:56 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:57 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 1073741824" returned: 0 in 0.738s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:57 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 Nov 02 17:51:57 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:58 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834" returned: 0 in 0.490s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:51:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:51:58 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Attempting download of 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume 609146eb-92de-4fe3-897f-91e94178b834. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 17:51:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[930fca77-2b6d-4eca-9afa-df8b96b8fc97]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:58 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk Nov 02 17:51:58 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:59 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk" returned: 0 in 0.747s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:59 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk Nov 02 17:51:59 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:51:59 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Nov 02 17:51:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk" returned: 1 in 0.491s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:51:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_yvd881mk' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:51:59 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6775c8bd-6869-42a6-85bd-82a6646db3b7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:51:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:51:59 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD Nov 02 17:51:59 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:00 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD" returned: 0 in 0.543s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:00 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] 789043a6-2392-4529-ac6f-09077d7c12df was qcow2, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 17:52:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:00 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 Nov 02 17:52:00 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Flow 'volume_create_manager' (ba6da3e9-17cc-4abf-b5d5-a384fa507210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4225c8-d22c-4414-a3ab-1df1b164dbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed4225c8-d22c-4414-a3ab-1df1b164dbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1825794962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb9d5f3-a2c0-4167-bd4b-533d85185e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da577df99b9540479a88042cd591371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:03Z,use_quota=True,user_id='9208a0aa7078495fa2787c67451a6992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a030659f-73a3-43f1-99ba-15b10b7f81d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a030659f-73a3-43f1-99ba-15b10b7f81d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd56af84-bde5-4c85-bef8-687503635232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd56af84-bde5-4c85-bef8-687503635232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb9d5f3-a2c0-4167-bd4b-533d85185e03', 'volume_name': 'volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630b82c0-4c7e-4dc2-a286-a8557ff705dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (630b82c0-4c7e-4dc2-a286-a8557ff705dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4740ef5f-c883-4c87-96b6-c24aa6570c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Volume afb9d5f3-a2c0-4167-bd4b-533d85185e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03', 'volume_size': 1} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1825794962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb9d5f3-a2c0-4167-bd4b-533d85185e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da577df99b9540479a88042cd591371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:03Z,use_quota=True,user_id='9208a0aa7078495fa2787c67451a6992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Creating volume afb9d5f3-a2c0-4167-bd4b-533d85185e03 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:52:02 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:52:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:02 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 1073741824 Nov 02 17:52:02 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:03 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834" returned: 0 in 2.884s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_344n5acldevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:52:03 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Converted 112.00 MB image at 38.77 MB/s Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:03 devstack sudo[93702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 1G Nov 02 17:52:03 devstack sudo[93702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:03 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 1073741824" returned: 0 in 0.646s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:03 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 Nov 02 17:52:03 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:03 devstack sudo[93702]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 1G" returned: 0 in 0.507s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Downloaded image 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume 609146eb-92de-4fe3-897f-91e94178b834 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df for user bc84559ce3f24766a1db492c0ab6711f is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Marking volume 609146eb-92de-4fe3-897f-91e94178b834 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Copying metadata from image 789043a6-2392-4529-ac6f-09077d7c12df to 609146eb-92de-4fe3-897f-91e94178b834. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Creating volume glance metadata for volume 609146eb-92de-4fe3-897f-91e94178b834 backed by image 789043a6-2392-4529-ac6f-09077d7c12df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25243ebd-3bcc-4048-908d-7872c1f88d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609146eb-92de-4fe3-897f-91e94178b834', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02ace6b-5559-471e-9c2e-4cfdb9948f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:03 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Volume volume-609146eb-92de-4fe3-897f-91e94178b834 (609146eb-92de-4fe3-897f-91e94178b834): created successfully Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02ace6b-5559-471e-9c2e-4cfdb9948f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Flow 'volume_create_manager' (70b47063-182b-481e-8f9c-47432902e889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:03 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-06f0577d-046a-46bb-9e98-345f998b4a9b tempest-ServerActionsTestOtherA-313824487 None] Created volume successfully. Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03" returned: 0 in 0.382s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4740ef5f-c883-4c87-96b6-c24aa6570c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d4eda9-fbe2-4134-9b29-29b376974560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:03 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Volume volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 (afb9d5f3-a2c0-4167-bd4b-533d85185e03): created successfully Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d4eda9-fbe2-4134-9b29-29b376974560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Flow 'volume_create_manager' (ba6da3e9-17cc-4abf-b5d5-a384fa507210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e7e28a8c-3777-4ca3-968a-339c8a8acd1a tempest-AttachVolumeTestJSON-713895963 None] Created volume successfully. Nov 02 17:52:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-0f422f13-3bc6-4d07-93c1-c68454830059 req-118cf9ef-f32d-4988-ab35-a84d3ea6888f tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-0f422f13-3bc6-4d07-93c1-c68454830059 req-118cf9ef-f32d-4988-ab35-a84d3ea6888f tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-0f422f13-3bc6-4d07-93c1-c68454830059 req-118cf9ef-f32d-4988-ab35-a84d3ea6888f tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-0f422f13-3bc6-4d07-93c1-c68454830059 req-118cf9ef-f32d-4988-ab35-a84d3ea6888f tempest-AttachVolumeTestJSON-713895963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3f89676-bcde-443b-960e-15e09ef4ae05', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:52:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-0f422f13-3bc6-4d07-93c1-c68454830059 req-118cf9ef-f32d-4988-ab35-a84d3ea6888f tempest-AttachVolumeTestJSON-713895963 None] attachment_update completed successfully. Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-88cd5560-cccd-4bc7-9845-17c0ee71f2e7 req-eedaed82-cd04-4e17-a923-f5b07cafc2a4 tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-88cd5560-cccd-4bc7-9845-17c0ee71f2e7 req-eedaed82-cd04-4e17-a923-f5b07cafc2a4 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-88cd5560-cccd-4bc7-9845-17c0ee71f2e7 req-eedaed82-cd04-4e17-a923-f5b07cafc2a4 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Flow 'volume_create_manager' (768ea22d-afa6-41a5-b5b1-6b67525d6ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963d9846-7253-44c1-b169-bd9259245413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-88cd5560-cccd-4bc7-9845-17c0ee71f2e7 req-eedaed82-cd04-4e17-a923-f5b07cafc2a4 tempest-ServerActionsTestOtherA-313824487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-609146eb-92de-4fe3-897f-91e94178b834', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bee0f517-5484-4740-b89f-bd0ceedc1dd4', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963d9846-7253-44c1-b169-bd9259245413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-521669432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491652b6-68d9-4f60-b1bb-d6fb3b51773f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da577df99b9540479a88042cd591371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:09Z,use_quota=True,user_id='9208a0aa7078495fa2787c67451a6992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdc0d53-fcb6-44e2-8398-73c73a9d4add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fdc0d53-fcb6-44e2-8398-73c73a9d4add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001089cc-163b-4992-8023-db3a0990e71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001089cc-163b-4992-8023-db3a0990e71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491652b6-68d9-4f60-b1bb-d6fb3b51773f', 'volume_name': 'volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfdea47-e31e-49d5-8cb3-bb8e7c06a925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecfdea47-e31e-49d5-8cb3-bb8e7c06a925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f61ebd4-7f68-453b-8bd1-2ea2ab78d3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Volume 491652b6-68d9-4f60-b1bb-d6fb3b51773f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f', 'volume_size': 1} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-521669432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491652b6-68d9-4f60-b1bb-d6fb3b51773f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da577df99b9540479a88042cd591371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:09Z,use_quota=True,user_id='9208a0aa7078495fa2787c67451a6992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Creating volume 491652b6-68d9-4f60-b1bb-d6fb3b51773f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:52:08 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:52:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:09 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f 1073741824 Nov 02 17:52:09 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:09 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-88cd5560-cccd-4bc7-9845-17c0ee71f2e7 req-eedaed82-cd04-4e17-a923-f5b07cafc2a4 tempest-ServerActionsTestOtherA-313824487 None] attachment_update completed successfully. Nov 02 17:52:09 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f 1073741824" returned: 0 in 0.695s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:09 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f Nov 02 17:52:09 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:10 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f" returned: 0 in 0.364s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f61ebd4-7f68-453b-8bd1-2ea2ab78d3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf3094c-af29-45d6-9a2a-23b5cd39dba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:10 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Volume volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f (491652b6-68d9-4f60-b1bb-d6fb3b51773f): created successfully Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf3094c-af29-45d6-9a2a-23b5cd39dba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Flow 'volume_create_manager' (768ea22d-afa6-41a5-b5b1-6b67525d6ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-65c7f8db-0ebe-425a-a420-b15ad016eb11 tempest-AttachVolumeTestJSON-713895963 None] Created volume successfully. Nov 02 17:52:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-d551d66c-a778-4c97-8b52-6a70874cffed req-2e0c1cbe-419e-461c-b058-c5a635356b2c tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-d551d66c-a778-4c97-8b52-6a70874cffed req-2e0c1cbe-419e-461c-b058-c5a635356b2c tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-d551d66c-a778-4c97-8b52-6a70874cffed req-2e0c1cbe-419e-461c-b058-c5a635356b2c tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-d551d66c-a778-4c97-8b52-6a70874cffed req-2e0c1cbe-419e-461c-b058-c5a635356b2c tempest-AttachVolumeTestJSON-713895963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8c4d51a-50a9-4d65-9bd8-67d5cd08961c', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:52:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-d551d66c-a778-4c97-8b52-6a70874cffed req-2e0c1cbe-419e-461c-b058-c5a635356b2c tempest-AttachVolumeTestJSON-713895963 None] attachment_update completed successfully. Nov 02 17:52:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Acquiring lock "cinder-b53b3841-8314-4b51-b483-ecaeef81d535-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Lock "cinder-b53b3841-8314-4b51-b483-ecaeef81d535-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Acquiring lock "cinder-quobyte-b53b3841-8314-4b51-b483-ecaeef81d535" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Lock "cinder-quobyte-b53b3841-8314-4b51-b483-ecaeef81d535" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b764db7-2cb3-4437-b3fe-78e892f1d500]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:15 devstack sudo[94227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 Nov 02 17:52:15 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-90bbcaa4-b023-4407-a6be-42537012ffa8 req-fac42d11-6043-4ff0-b8e4-ec82cf5c4361 tempest-AttachVolumeTestJSON-713895963 None] Terminate volume connection completed successfully. Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-90bbcaa4-b023-4407-a6be-42537012ffa8 req-fac42d11-6043-4ff0-b8e4-ec82cf5c4361 tempest-AttachVolumeTestJSON-713895963 None] Deleting attachment f3f89676-bcde-443b-960e-15e09ef4ae05. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:52:15 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535" returned: 0 in 0.632s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:15 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535 Nov 02 17:52:15 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:16 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b53b3841-8314-4b51-b483-ecaeef81d535" returned: 0 in 0.493s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Lock "cinder-quobyte-b53b3841-8314-4b51-b483-ecaeef81d535" released by "delete_volume" :: held 1.222s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Created reservations ['e2197023-5c29-49a4-8d45-903cf3ce58f6', '430c43a9-9a9b-4c73-a6eb-a2d1bf368fa8', 'ac871978-fde1-4420-b7d5-22c7c9e108be', '17736de1-e2b1-48db-8f27-a403242c28e5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:16 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:52:16 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Flow 'volume_create_manager' (9ab1c42b-104c-4fc1-86e4-e8d7d280ba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e41371-8bda-4cd4-8b95-ee263e103f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e41371-8bda-4cd4-8b95-ee263e103f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-284296100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b578f331-c2b1-4470-a075-6e54dc3b5f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb4421794246eb82821ca6de69dd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:17Z,use_quota=True,user_id='44ac4f4e94d34a8ba872a038b5d3397d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10317d0-9f09-486f-a169-c5fa30cb31d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10317d0-9f09-486f-a169-c5fa30cb31d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac2036a-0676-4542-9dc9-2f9e0afd2789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac2036a-0676-4542-9dc9-2f9e0afd2789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b578f331-c2b1-4470-a075-6e54dc3b5f59', 'volume_name': 'volume-b578f331-c2b1-4470-a075-6e54dc3b5f59', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6d74ea-bb3f-4f76-9712-0e22e3fad046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6d74ea-bb3f-4f76-9712-0e22e3fad046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e07746-b1ac-43e0-8a7d-16dd2e15916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Volume b578f331-c2b1-4470-a075-6e54dc3b5f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b578f331-c2b1-4470-a075-6e54dc3b5f59', 'volume_size': 1} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-284296100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b578f331-c2b1-4470-a075-6e54dc3b5f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='facb4421794246eb82821ca6de69dd0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:17Z,use_quota=True,user_id='44ac4f4e94d34a8ba872a038b5d3397d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Creating volume b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:52:16 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:52:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:17 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 1073741824 Nov 02 17:52:17 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:17 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.535s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:52:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Deleted volume successfully. Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8ed06551-428e-4c01-9e5f-c869ba24a147 tempest-VolumesNegativeTest-454571863 None] Lock "cinder-b53b3841-8314-4b51-b483-ecaeef81d535-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=99,cinder:UPDATE=105,cinder:INSERT=29,cinder:DELETE=8 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:52:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-a2de73a5-9622-468d-bfa2-9cdb7be5fffb req-79b350de-644b-4cea-96da-e37f3531d865 tempest-AttachVolumeTestJSON-713895963 None] Terminate volume connection completed successfully. Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-a2de73a5-9622-468d-bfa2-9cdb7be5fffb req-79b350de-644b-4cea-96da-e37f3531d865 tempest-AttachVolumeTestJSON-713895963 None] Deleting attachment d8c4d51a-50a9-4d65-9bd8-67d5cd08961c. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:52:17 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 1073741824" returned: 0 in 0.800s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:17 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:52:17 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:18 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.406s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=96,cinder:UPDATE=101,cinder:INSERT=27,cinder:DELETE=10 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e07746-b1ac-43e0-8a7d-16dd2e15916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b578f331-c2b1-4470-a075-6e54dc3b5f59', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ec844-b7f1-433b-afe7-a0b353623b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Volume volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 (b578f331-c2b1-4470-a075-6e54dc3b5f59): created successfully Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4ec844-b7f1-433b-afe7-a0b353623b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Flow 'volume_create_manager' (9ab1c42b-104c-4fc1-86e4-e8d7d280ba4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e0a57b3a-09e5-41d3-b289-17033d296512 tempest-VolumesActionsTest-2046848613 None] Created volume successfully. Nov 02 17:52:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "cinder-491652b6-68d9-4f60-b1bb-d6fb3b51773f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-491652b6-68d9-4f60-b1bb-d6fb3b51773f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "cinder-quobyte-491652b6-68d9-4f60-b1bb-d6fb3b51773f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-quobyte-491652b6-68d9-4f60-b1bb-d6fb3b51773f" acquired by "delete_volume" :: waited 0.069s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:26 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84a0f4-1bff-4296-bab9-8a9f6e194197]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:26 devstack sudo[94368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f Nov 02 17:52:26 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:26 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f" returned: 0 in 0.743s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:27 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f Nov 02 17:52:27 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:27 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-491652b6-68d9-4f60-b1bb-d6fb3b51773f" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-quobyte-491652b6-68d9-4f60-b1bb-d6fb3b51773f" released by "delete_volume" :: held 1.336s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Created reservations ['3316398c-1e54-4716-8824-8a4a64970cae', '65e48473-bc59-46cd-ba29-e2c036b4e053', 'cdc7d779-6362-40c3-9c7b-4f3f375c055f', '180f38c7-df93-46a1-a496-f151e965e03e'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:27 devstack sudo[94383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:52:27 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:28 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.528s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:52:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Deleted volume successfully. Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-888ecefb-de7d-446d-b0f1-9c5d60cbc85a tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-491652b6-68d9-4f60-b1bb-d6fb3b51773f-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "cinder-afb9d5f3-a2c0-4167-bd4b-533d85185e03-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-afb9d5f3-a2c0-4167-bd4b-533d85185e03-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "cinder-quobyte-afb9d5f3-a2c0-4167-bd4b-533d85185e03" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-quobyte-afb9d5f3-a2c0-4167-bd4b-533d85185e03" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e455669-e622-4f97-8214-d21aa7ee822f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:28 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 Nov 02 17:52:28 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:29 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03" returned: 0 in 0.628s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:29 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03 Nov 02 17:52:29 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:29 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-afb9d5f3-a2c0-4167-bd4b-533d85185e03" returned: 0 in 0.317s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-quobyte-afb9d5f3-a2c0-4167-bd4b-533d85185e03" released by "delete_volume" :: held 1.012s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Created reservations ['a140d461-2b87-47ed-87fa-a06722e66c48', '11a4a00a-f701-45e6-8f7c-f98657c8baae', '5dfce635-cb5a-4898-868b-426f8975f82f', '99f54f6e-5229-4731-888f-a9ac1c4c26f0'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:29 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:52:29 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:30 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.291s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:52:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Deleted volume successfully. Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-185ac26f-dbf4-446d-94f0-b64d5c3f9b62 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-afb9d5f3-a2c0-4167-bd4b-533d85185e03-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "cinder-a2ddb460-45ab-40af-a02c-2b42720e6611-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-a2ddb460-45ab-40af-a02c-2b42720e6611-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "cinder-quobyte-a2ddb460-45ab-40af-a02c-2b42720e6611" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-quobyte-a2ddb460-45ab-40af-a02c-2b42720e6611" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:31 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e5a01c-93d9-4407-9ed5-6c7ce106c60e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:31 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 Nov 02 17:52:31 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:31 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611" returned: 0 in 0.473s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:31 devstack sudo[94406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611 Nov 02 17:52:31 devstack sudo[94406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:31 devstack sudo[94406]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a2ddb460-45ab-40af-a02c-2b42720e6611" returned: 0 in 0.407s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-quobyte-a2ddb460-45ab-40af-a02c-2b42720e6611" released by "delete_volume" :: held 0.954s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Created reservations ['ad278d34-05a9-46bf-b67b-1fe0ae2fcb8e', '53ac3424-80b0-4461-8d2e-d931b0d5ca42', 'ab30b8a5-8c2c-461d-94fd-7210ed372c43', 'd76ec63a-5937-443a-8540-bd3c651be2a1'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:32 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:52:32 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:32 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.405s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:52:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Deleted volume successfully. Nov 02 17:52:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-131d1732-dba0-4bee-b92b-4e15a650c687 tempest-AttachVolumeTestJSON-713895963 None] Lock "cinder-a2ddb460-45ab-40af-a02c-2b42720e6611-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:39 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:52:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (7db35e85-12e1-404f-9c24-bb082f070adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8f2265-cec5-4a06-be6a-dbd50be082c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8f2265-cec5-4a06-be6a-dbd50be082c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375470193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4142dbb5-ccdc-4471-abba-857a2a205e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:40Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c369c2-1ffa-4aa0-aa2d-fc3429bd763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46c369c2-1ffa-4aa0-aa2d-fc3429bd763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaa7a7a-303e-482c-a161-38dd213c4ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaa7a7a-303e-482c-a161-38dd213c4ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4142dbb5-ccdc-4471-abba-857a2a205e7b', 'volume_name': 'volume-4142dbb5-ccdc-4471-abba-857a2a205e7b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b8566f-e7b1-433d-bff7-5297a006a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b8566f-e7b1-433d-bff7-5297a006a24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec9f7c4-86b5-4425-a72d-88cf2b03df31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Volume 4142dbb5-ccdc-4471-abba-857a2a205e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4142dbb5-ccdc-4471-abba-857a2a205e7b', 'volume_size': 1} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-375470193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4142dbb5-ccdc-4471-abba-857a2a205e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:40Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Creating volume 4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:52:40 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:40 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b 1073741824 Nov 02 17:52:40 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-baa92cc2-ab54-40c3-a677-4eca9c026620 tempest-ServerActionsTestOtherA-313824487 None] Terminate volume connection completed successfully. Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-baa92cc2-ab54-40c3-a677-4eca9c026620 tempest-ServerActionsTestOtherA-313824487 None] Deleting attachment bee0f517-5484-4740-b89f-bd0ceedc1dd4. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-eb51891d-0ea1-496a-8b30-d628c4c455d3 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59" by "attach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-eb51891d-0ea1-496a-8b30-d628c4c455d3 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59" acquired by "attach_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-eb51891d-0ea1-496a-8b30-d628c4c455d3 tempest-VolumesActionsTest-2046848613 None] Attaching volume b578f331-c2b1-4470-a075-6e54dc3b5f59 to instance 7467505b-d9c0-484b-9ae0-4f68c9de5457 at mountpoint /dev/vdb on host None. Nov 02 17:52:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-eb51891d-0ea1-496a-8b30-d628c4c455d3 tempest-VolumesActionsTest-2046848613 None] Attach volume completed successfully. Nov 02 17:52:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-eb51891d-0ea1-496a-8b30-d628c4c455d3 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59" released by "attach_volume" :: held 0.213s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:41 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b 1073741824" returned: 0 in 0.937s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6b9df396-5e2e-4cb7-9368-18ac26f79342 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-detach_volume" by "detach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6b9df396-5e2e-4cb7-9368-18ac26f79342 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6b9df396-5e2e-4cb7-9368-18ac26f79342 tempest-VolumesActionsTest-2046848613 None] Detaching volume b578f331-c2b1-4470-a075-6e54dc3b5f59 from instance 7467505b-d9c0-484b-9ae0-4f68c9de5457. Nov 02 17:52:41 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b Nov 02 17:52:41 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6b9df396-5e2e-4cb7-9368-18ac26f79342 tempest-VolumesActionsTest-2046848613 None] Detach volume completed successfully. Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6b9df396-5e2e-4cb7-9368-18ac26f79342 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:41 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b" returned: 0 in 0.592s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ec9f7c4-86b5-4425-a72d-88cf2b03df31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4142dbb5-ccdc-4471-abba-857a2a205e7b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36034e1c-199a-451c-8b81-72a7eed527bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:41 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Volume volume-4142dbb5-ccdc-4471-abba-857a2a205e7b (4142dbb5-ccdc-4471-abba-857a2a205e7b): created successfully Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36034e1c-199a-451c-8b81-72a7eed527bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (7db35e85-12e1-404f-9c24-bb082f070adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-490b73b0-d5c1-4039-9a7a-4ec1a83860d9 tempest-VolumesSnapshotTestJSON-890391627 None] Created volume successfully. Nov 02 17:52:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Creating offline snapshot 4aa33ac7-4697-4821-ba91-61d10131d165 of volume 4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:52:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac11cf-dbf7-44f3-856a-5ad11ed3e6c2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:42 devstack sudo[94544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b Nov 02 17:52:42 devstack sudo[94544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:43 devstack sudo[94544]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b" returned: 0 in 0.411s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:43 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 1G Nov 02 17:52:43 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:43 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 1G" returned: 0 in 0.694s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4142dbb5-ccdc-4471-abba-857a2a205e7b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:43 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4142dbb5-ccdc-4471-abba-857a2a205e7b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 Nov 02 17:52:43 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:44 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4142dbb5-ccdc-4471-abba-857a2a205e7b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165" returned: 0 in 0.438s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:44 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 is being set with open permissions: ugo+rw Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:44 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 Nov 02 17:52:44 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-c0dea1f9-7b8f-4dbf-b89f-85cb40232f6b tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:44 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165" returned: 0 in 0.279s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:44 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info Nov 02 17:52:44 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:44 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info" returned: 0 in 0.262s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:44 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info is being set with open permissions: ugo+rw Nov 02 17:52:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:44 devstack sudo[94580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info Nov 02 17:52:44 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:45 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.info" returned: 0 in 0.356s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-c0dea1f9-7b8f-4dbf-b89f-85cb40232f6b tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.805s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-c0dea1f9-7b8f-4dbf-b89f-85cb40232f6b tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c0afd6be-03f6-4739-95f4-925ccf5fabaf tempest-VolumesSnapshotTestJSON-890391627 None] Create snapshot completed successfully Nov 02 17:52:45 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-c0dea1f9-7b8f-4dbf-b89f-85cb40232f6b tempest-ServerActionsTestOtherA-313824487 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-609146eb-92de-4fe3-897f-91e94178b834', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce537e5b-239c-4c87-954c-d52975c4ee1f', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:52:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-65185bc3-206d-4ea6-a581-f7ff3c551c76 req-c0dea1f9-7b8f-4dbf-b89f-85cb40232f6b tempest-ServerActionsTestOtherA-313824487 None] attachment_update completed successfully. Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-4aa33ac7-4697-4821-ba91-61d10131d165-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-4aa33ac7-4697-4821-ba91-61d10131d165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-4142dbb5-ccdc-4471-abba-857a2a205e7b" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4142dbb5-ccdc-4471-abba-857a2a205e7b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-4aa33ac7-4697-4821-ba91-61d10131d165" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4aa33ac7-4697-4821-ba91-61d10131d165" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Deleting offline snapshot 4aa33ac7-4697-4821-ba91-61d10131d165 of volume 4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] snapshot_file for this snap is: volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18f1b23-48f9-4d27-bc5a-73ed815f5844]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:46 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:52:46 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:46 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 Nov 02 17:52:46 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:47 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.498s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:52:47 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165" returned: 0 in 0.735s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4142dbb5-ccdc-4471-abba-857a2a205e7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f5d96c-1a03-4e51-b224-81119e1281a2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:47 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b Nov 02 17:52:47 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:47 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b" returned: 0 in 0.597s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:47 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 Nov 02 17:52:47 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:48 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165" returned: 0 in 0.653s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:48 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165 Nov 02 17:52:48 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:49 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b.4aa33ac7-4697-4821-ba91-61d10131d165" returned: 0 in 0.709s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4aa33ac7-4697-4821-ba91-61d10131d165" released by "_delete_snapshot" :: held 2.976s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4142dbb5-ccdc-4471-abba-857a2a205e7b" released by "delete_snapshot" :: held 3.040s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:49 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['c962c2d8-74b3-4b49-a234-e715b1dd30ae', 'd01b557f-257b-4b7f-a3d0-4ee5925edcfc', '9cf5fea9-0bc7-4b9d-a1f4-469016b91b72', 'a7217846-6ca2-4bb1-a7d3-b7ef7b85cb91'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:52:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Delete snapshot completed successfully. Nov 02 17:52:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7cdb6dde-eb81-4111-87d5-46f3a8cc2f4c tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-4aa33ac7-4697-4821-ba91-61d10131d165-delete_snapshot" released by "delete_snapshot" :: held 3.454s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (70f82e1e-6bb1-4662-a858-3607ebfa0867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d725d0-fcb9-4ca6-8bff-e9ae7867ab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d725d0-fcb9-4ca6-8bff-e9ae7867ab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1086253658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b55fdbb-8797-41e0-af98-7778a4c24964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:52Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9ba743-ee40-4e96-9b49-d3e8eb62f672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9ba743-ee40-4e96-9b49-d3e8eb62f672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc2ca0d-ff28-4439-aa2d-66b9506f5920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc2ca0d-ff28-4439-aa2d-66b9506f5920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b55fdbb-8797-41e0-af98-7778a4c24964', 'volume_name': 'volume-0b55fdbb-8797-41e0-af98-7778a4c24964', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1c19ff-63b9-4f58-8b98-85290d90b9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1c19ff-63b9-4f58-8b98-85290d90b9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e6521-28c8-49e5-a280-9261f103b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:51 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Volume 0b55fdbb-8797-41e0-af98-7778a4c24964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b55fdbb-8797-41e0-af98-7778a4c24964', 'volume_size': 1} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1086253658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b55fdbb-8797-41e0-af98-7778a4c24964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:52:52Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Creating volume 0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:52:51 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:52:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:51 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 1073741824 Nov 02 17:52:51 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:52 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 1073741824" returned: 0 in 0.831s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:52 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 Nov 02 17:52:52 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:53 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964" returned: 0 in 0.382s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1e6521-28c8-49e5-a280-9261f103b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b55fdbb-8797-41e0-af98-7778a4c24964', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc0ea02-9f44-4e63-9718-13379cec040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:52:53 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Volume volume-0b55fdbb-8797-41e0-af98-7778a4c24964 (0b55fdbb-8797-41e0-af98-7778a4c24964): created successfully Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc0ea02-9f44-4e63-9718-13379cec040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:52:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (70f82e1e-6bb1-4662-a858-3607ebfa0867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:52:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ce030055-3579-4e1f-8af8-4c516974ccb0 tempest-VolumesSnapshotTestJSON-890391627 None] Created volume successfully. Nov 02 17:52:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:52:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:52:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Creating offline snapshot 403ce2e4-773c-498a-a391-b348d25debeb of volume 0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:52:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e8572-6139-478f-a0db-2a64fb0e3d65]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:52:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:55 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 Nov 02 17:52:55 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:56 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964" returned: 0 in 1.208s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:56 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb 1G Nov 02 17:52:56 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:57 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb 1G" returned: 0 in 1.372s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b55fdbb-8797-41e0-af98-7778a4c24964 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:57 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b55fdbb-8797-41e0-af98-7778a4c24964 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb Nov 02 17:52:57 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:58 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b55fdbb-8797-41e0-af98-7778a4c24964 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb" returned: 0 in 0.557s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:58 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb is being set with open permissions: ugo+rw Nov 02 17:52:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:58 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb Nov 02 17:52:58 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:58 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb" returned: 0 in 0.774s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:59 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info Nov 02 17:52:59 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:52:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c5ab768-81cc-4194-b3e6-723db8938bca tempest-VolumesActionsTest-2046848613 None] Acquiring lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59" by "attach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:52:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c5ab768-81cc-4194-b3e6-723db8938bca tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59" acquired by "attach_volume" :: waited 0.055s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:52:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9c5ab768-81cc-4194-b3e6-723db8938bca tempest-VolumesActionsTest-2046848613 None] Attaching volume b578f331-c2b1-4470-a075-6e54dc3b5f59 to instance 8f9db163-5ad1-43c7-ba41-aa6638577834 at mountpoint /dev/vdb on host None. Nov 02 17:52:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9c5ab768-81cc-4194-b3e6-723db8938bca tempest-VolumesActionsTest-2046848613 None] Attach volume completed successfully. Nov 02 17:52:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c5ab768-81cc-4194-b3e6-723db8938bca tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59" released by "attach_volume" :: held 0.226s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:52:59 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Nov 02 17:52:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info" returned: 0 in 0.557s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:52:59 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info is being set with open permissions: ugo+rw Nov 02 17:52:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:52:59 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info Nov 02 17:52:59 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:00 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.info" returned: 0 in 0.641s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.559s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0e63483c-b9db-42c2-9cc1-0356cc26b249 tempest-VolumesSnapshotTestJSON-890391627 None] Create snapshot completed successfully Nov 02 17:53:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40550e8c-e39e-4969-8062-d126cb8e9299 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-detach_volume" by "detach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40550e8c-e39e-4969-8062-d126cb8e9299 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-40550e8c-e39e-4969-8062-d126cb8e9299 tempest-VolumesActionsTest-2046848613 None] Detaching volume b578f331-c2b1-4470-a075-6e54dc3b5f59 from instance 8f9db163-5ad1-43c7-ba41-aa6638577834. Nov 02 17:53:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-40550e8c-e39e-4969-8062-d126cb8e9299 tempest-VolumesActionsTest-2046848613 None] Detach volume completed successfully. Nov 02 17:53:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40550e8c-e39e-4969-8062-d126cb8e9299 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (7e4d9796-1956-40df-8a20-d9a5b4bd5d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0559adb9-8f2a-4964-b9b1-51b5c2cd5069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0559adb9-8f2a-4964-b9b1-51b5c2cd5069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-790998207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdbc200-6c25-485b-8ba2-bc0893912bc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:53:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=403ce2e4-773c-498a-a391-b348d25debeb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:53:02Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0948df-4f2a-4228-ade9-f25f6c73778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0948df-4f2a-4228-ade9-f25f6c73778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0add080-7162-496e-a06f-41cfc04b05bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0add080-7162-496e-a06f-41cfc04b05bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bfdbc200-6c25-485b-8ba2-bc0893912bc4', 'volume_name': 'volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4', 'volume_size': 2, 'snapshot_id': '403ce2e4-773c-498a-a391-b348d25debeb'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71af56a8-9831-4e6a-82b7-e1945ddb97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71af56a8-9831-4e6a-82b7-e1945ddb97f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0039fd6-6d9e-480e-99be-6d441060b4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Volume bfdbc200-6c25-485b-8ba2-bc0893912bc4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4', 'volume_size': 2, 'snapshot_id': '403ce2e4-773c-498a-a391-b348d25debeb'} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-403ce2e4-773c-498a-a391-b348d25debeb-bfdbc200-6c25-485b-8ba2-bc0893912bc4" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-403ce2e4-773c-498a-a391-b348d25debeb-bfdbc200-6c25-485b-8ba2-bc0893912bc4" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Creating volume bfdbc200-6c25-485b-8ba2-bc0893912bc4 from snapshot 403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-bfdbc200-6c25-485b-8ba2-bc0893912bc4" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-bfdbc200-6c25-485b-8ba2-bc0893912bc4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] snapshot: 403ce2e4-773c-498a-a391-b348d25debeb, volume: bfdbc200-6c25-485b-8ba2-bc0893912bc4, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d0927d-6e8f-4989-86ab-110068e8343b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:02 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb Nov 02 17:53:02 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:03 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb" returned: 0 in 0.692s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b55fdbb-8797-41e0-af98-7778a4c24964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:53:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7612688-55bd-4485-a99b-b4173b378cb4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:03 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 Nov 02 17:53:03 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:04 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964" returned: 0 in 0.720s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 17:53:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 17:53:04 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 17:53:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:04 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 Nov 02 17:53:04 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:12 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=63,cinder:UPDATE=52,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:53:13 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4" returned: 0 in 8.940s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:53:13 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Converted 1024.00 MB image at 114.52 MB/s Nov 02 17:53:13 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 is being set with open permissions: ugo+rw Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:13 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 Nov 02 17:53:13 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:13 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-bfdbc200-6c25-485b-8ba2-bc0893912bc4" released by "_copy_volume_from_snapshot" :: held 10.746s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-403ce2e4-773c-498a-a391-b348d25debeb-bfdbc200-6c25-485b-8ba2-bc0893912bc4" released by "_create_volume_from_snapshot" :: held 10.816s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.842s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.004s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0039fd6-6d9e-480e-99be-6d441060b4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4', 'volume_size': 2, 'snapshot_id': '403ce2e4-773c-498a-a391-b348d25debeb'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4c247-7598-4cf7-bdaf-5321fcc1592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79458e-3dd4-4666-907e-af1fa432d60f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Volume volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 (bfdbc200-6c25-485b-8ba2-bc0893912bc4): created successfully Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a4c247-7598-4cf7-bdaf-5321fcc1592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (7e4d9796-1956-40df-8a20-d9a5b4bd5d00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:53:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-43429b5f-56e2-4e31-b5ac-073a9c52b904 tempest-VolumesSnapshotTestJSON-890391627 None] Created volume successfully. Nov 02 17:53:13 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:53:13 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-bfdbc200-6c25-485b-8ba2-bc0893912bc4-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-bfdbc200-6c25-485b-8ba2-bc0893912bc4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-bfdbc200-6c25-485b-8ba2-bc0893912bc4" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-bfdbc200-6c25-485b-8ba2-bc0893912bc4" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e687168f-3aac-41b8-8936-f2c73cea2c6a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:13 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.490s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc987d-980a-46e2-8684-5ae7b79ff1db]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:13 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 Nov 02 17:53:13 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:14 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:53:14 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:14 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4" returned: 0 in 0.409s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:14 devstack sudo[95344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4 Nov 02 17:53:14 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:14 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.494s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.565325cc-a03d-4024-9ebf-8b2b0fb42d116cinqcn1.img {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:14 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.565325cc-a03d-4024-9ebf-8b2b0fb42d116cinqcn1.img Nov 02 17:53:14 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:14 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bfdbc200-6c25-485b-8ba2-bc0893912bc4" returned: 0 in 0.343s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-bfdbc200-6c25-485b-8ba2-bc0893912bc4" released by "delete_volume" :: held 0.818s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['375a9fa8-0d1f-4203-aa24-e172273ea6fd', '859834ff-e9ff-40a5-9d65-e49a3fb50cb7', '4702a618-d91d-461a-aa1c-63aa63537af0', '0e44ddd7-e2e0-4c78-bcc0-a37264b7f936'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:14 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:53:14 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-403ce2e4-773c-498a-a391-b348d25debeb-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-403ce2e4-773c-498a-a391-b348d25debeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-0b55fdbb-8797-41e0-af98-7778a4c24964" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-0b55fdbb-8797-41e0-af98-7778a4c24964" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-403ce2e4-773c-498a-a391-b348d25debeb" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-403ce2e4-773c-498a-a391-b348d25debeb" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Deleting offline snapshot 403ce2e4-773c-498a-a391-b348d25debeb of volume 0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] snapshot_file for this snap is: volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08372a2-a189-4bf9-a6e7-bef9b8e4adb0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:15 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.869s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:53:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Deleted volume successfully. Nov 02 17:53:15 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb Nov 02 17:53:15 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4525fc90-05d9-45f6-a3bb-a4fd8e889083 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-bfdbc200-6c25-485b-8ba2-bc0893912bc4-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:16 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb" returned: 0 in 0.730s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b55fdbb-8797-41e0-af98-7778a4c24964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:53:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f183715f-2e96-417b-96ea-f18880a8fa33]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:16 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 Nov 02 17:53:16 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:17 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964" returned: 0 in 1.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:17 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb Nov 02 17:53:17 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:18 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb" returned: 0 in 0.845s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:18 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb Nov 02 17:53:18 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:18 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964.403ce2e4-773c-498a-a391-b348d25debeb" returned: 0 in 0.538s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:18 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=64,cinder:INSERT=17,cinder:UPDATE=59,cinder:DELETE=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:53:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-403ce2e4-773c-498a-a391-b348d25debeb" released by "_delete_snapshot" :: held 3.770s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-0b55fdbb-8797-41e0-af98-7778a4c24964" released by "delete_snapshot" :: held 3.826s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:19 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['a68442c6-620c-4b64-9768-8c219b3ef989', '6f644a0f-588e-47b1-9300-0f9d1e6aee13', '7cf73448-f852-40d4-9ebe-5ea6afe1d660', '10b71998-1923-4a4a-988a-a810686c0bc8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:53:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Delete snapshot completed successfully. Nov 02 17:53:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73d6a649-a852-4369-b771-7ee69673d258 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-403ce2e4-773c-498a-a391-b348d25debeb-delete_snapshot" released by "delete_snapshot" :: held 4.151s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-0b55fdbb-8797-41e0-af98-7778a4c24964-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-0b55fdbb-8797-41e0-af98-7778a4c24964-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-0b55fdbb-8797-41e0-af98-7778a4c24964" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-0b55fdbb-8797-41e0-af98-7778a4c24964" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf789ac-6312-40fa-8313-1305f528b646]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:20 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 Nov 02 17:53:20 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:21 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964" returned: 0 in 1.080s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:21 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964 Nov 02 17:53:21 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:21 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-0b55fdbb-8797-41e0-af98-7778a4c24964" returned: 0 in 0.652s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-0b55fdbb-8797-41e0-af98-7778a4c24964" released by "delete_volume" :: held 1.988s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['264b9bff-6383-4d87-a84f-194cc6e2c1e8', 'a04ac870-cc88-43a5-ab9b-b567055e15cf', 'ce65dafb-b7fa-423e-8c46-b7c51b55d1a8', '2b4eaa1d-8d8b-4979-83e9-b5f365158552'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:22 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:53:22 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:23 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.710s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:23 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:53:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Deleted volume successfully. Nov 02 17:53:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76bdcb98-898d-4d9f-b820-c0c22c925647 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-0b55fdbb-8797-41e0-af98-7778a4c24964-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:24 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.565325cc-a03d-4024-9ebf-8b2b0fb42d116cinqcn1.img" returned: 0 in 10.534s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f4f063-014b-4f16-91a7-a50d7484cc05]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-4536ecb2-fe7d-439a-aba0-efc7a5932d41 tempest-ServerActionsTestOtherA-313824487 None] Terminate volume connection completed successfully. Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-4536ecb2-fe7d-439a-aba0-efc7a5932d41 tempest-ServerActionsTestOtherA-313824487 None] Deleting attachment ce537e5b-239c-4c87-954c-d52975c4ee1f. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:53:25 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:53:25 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (d92953bf-0d93-4437-b12c-b12a39a96846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ae6cea-d143-4c96-8579-9e9791db2880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ae6cea-d143-4c96-8579-9e9791db2880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255763614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcb6113-81ab-4cab-b3d9-b1f770253151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:53:25Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4bac24-1369-42e6-8fcc-53a866c2aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4bac24-1369-42e6-8fcc-53a866c2aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c1e6f0-c795-4a9a-8322-5357c98bb5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c1e6f0-c795-4a9a-8322-5357c98bb5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcb6113-81ab-4cab-b3d9-b1f770253151', 'volume_name': 'volume-4bcb6113-81ab-4cab-b3d9-b1f770253151', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65315fa2-e3c2-4d89-80bf-05cf917b83fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65315fa2-e3c2-4d89-80bf-05cf917b83fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcc0c4e-0a9d-4765-96b4-8d1cca9da03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Volume 4bcb6113-81ab-4cab-b3d9-b1f770253151: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcb6113-81ab-4cab-b3d9-b1f770253151', 'volume_size': 1} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "cinder-609146eb-92de-4fe3-897f-91e94178b834-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-609146eb-92de-4fe3-897f-91e94178b834-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "cinder-quobyte-609146eb-92de-4fe3-897f-91e94178b834" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-quobyte-609146eb-92de-4fe3-897f-91e94178b834" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b0bb62-b9f5-45cc-bbfc-61e8d0a2d154]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:25 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 Nov 02 17:53:25 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:26 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 1.040s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59, size 1024.00 MB, duration 10.54 sec, destination /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.565325cc-a03d-4024-9ebf-8b2b0fb42d116cinqcn1.img {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:53:26 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Converted 1024.00 MB image at 97.14 MB/s Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] 565325cc-a03d-4024-9ebf-8b2b0fb42d11 was raw, no need to convert to raw {{(pid=86585) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 17:53:26 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834" returned: 0 in 0.563s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:26 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834 Nov 02 17:53:26 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:26 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-609146eb-92de-4fe3-897f-91e94178b834" returned: 0 in 0.368s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-quobyte-609146eb-92de-4fe3-897f-91e94178b834" released by "delete_volume" :: held 1.000s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG cinder.quota [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Created reservations ['7acbc805-3151-4382-8bb4-5061970833c6', 'ea34e4e2-db6f-4d3a-bfef-504aa2fff5d4', '6f016ed9-690b-41db-864c-12adc2a486dd', '7617e327-73ab-43f2-9b08-529afe71678b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:26 devstack sudo[95548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:53:27 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "cinder-8e4c4add-6373-42a0-b9d0-5a1783adbe88-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-8e4c4add-6373-42a0-b9d0-5a1783adbe88-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "cinder-quobyte-8e4c4add-6373-42a0-b9d0-5a1783adbe88" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-quobyte-8e4c4add-6373-42a0-b9d0-5a1783adbe88" acquired by "delete_volume" :: waited 0.050s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7618f4-bae6-4e6d-ab1a-5a27e365311f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:27 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 Nov 02 17:53:27 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:27 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.670s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG cinder.manager [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:53:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Deleted volume successfully. Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-dd5c7900-b7ed-4cf5-a45f-d034e9d2e81f req-0dbc4717-eb5d-4abf-a176-c7ffb98c180d tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-609146eb-92de-4fe3-897f-91e94178b834-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:27 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88" returned: 0 in 0.497s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:27 devstack sudo[95557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88 Nov 02 17:53:27 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:28 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e4c4add-6373-42a0-b9d0-5a1783adbe88" returned: 0 in 0.345s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-quobyte-8e4c4add-6373-42a0-b9d0-5a1783adbe88" released by "delete_volume" :: held 0.918s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Created reservations ['c311a242-ad96-4cf4-b46b-c5529776ae0d', '46717963-9c72-474e-8288-36b542f9e610', '047c4a35-236c-4ed0-bf6b-2b657b92b927', '553a2ccd-9d65-4713-8c98-c4a27f2e55e6'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:28 devstack sudo[95560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:53:28 devstack sudo[95560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:28 devstack sudo[95560]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.345s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:53:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Deleted volume successfully. Nov 02 17:53:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-822bfbf4-1d68-4089-900c-e5a6bd828df9 tempest-ServerActionsTestOtherA-313824487 None] Lock "cinder-8e4c4add-6373-42a0-b9d0-5a1783adbe88-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:53:38 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=23,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:53:38 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=32,cinder:UPDATE=37,cinder:DELETE=2,cinder:INSERT=12 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:46 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:53:46 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:46 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:53:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Flow 'volume_create_manager' (ceb041c7-9c5a-4e76-9857-207da0cda9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3183d08-c750-4d51-8757-23af9d83de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3183d08-c750-4d51-8757-23af9d83de60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1304526421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692c1b3b-fba1-4209-b11a-53eb57947247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e3feb8491046e4a7e2d0d85b6ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:53:51Z,use_quota=True,user_id='0248314279304d109d76e5fc0c75c27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0481cfda-ff93-42a8-a3ba-52af6620197a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0481cfda-ff93-42a8-a3ba-52af6620197a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e57bdb-4547-4268-a3a5-287888f72609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e57bdb-4547-4268-a3a5-287888f72609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '692c1b3b-fba1-4209-b11a-53eb57947247', 'volume_name': 'volume-692c1b3b-fba1-4209-b11a-53eb57947247', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a515942-7539-4b3b-9a68-cb4cfbc2b30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a515942-7539-4b3b-9a68-cb4cfbc2b30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43926633-099c-4e4b-8112-8e8c1476640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:50 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Volume 692c1b3b-fba1-4209-b11a-53eb57947247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-692c1b3b-fba1-4209-b11a-53eb57947247', 'volume_size': 1} Nov 02 17:53:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.305s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Uploaded volume to glance image-id: 565325cc-a03d-4024-9ebf-8b2b0fb42d11. {{(pid=86585) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.105s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-255763614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcb6113-81ab-4cab-b3d9-b1f770253151,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:53:25Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Creating volume 4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:53:51 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:53:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:51 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 1073741824 Nov 02 17:53:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b58d2005-330d-4e55-b86f-8aa5db37c710 tempest-VolumesActionsTest-2046848613 None] Copy volume to image completed successfully. Nov 02 17:53:51 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:52 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 1073741824" returned: 0 in 0.534s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:52 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 Nov 02 17:53:52 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:52 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151" returned: 0 in 0.339s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.696s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1304526421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=692c1b3b-fba1-4209-b11a-53eb57947247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e3feb8491046e4a7e2d0d85b6ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:53:51Z,use_quota=True,user_id='0248314279304d109d76e5fc0c75c27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Creating volume 692c1b3b-fba1-4209-b11a-53eb57947247 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:53:52 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcc0c4e-0a9d-4765-96b4-8d1cca9da03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcb6113-81ab-4cab-b3d9-b1f770253151', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68f4c82-b08b-4ac1-9f21-d17a5b28a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:52 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 1073741824 Nov 02 17:53:52 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:52 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Volume volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 (4bcb6113-81ab-4cab-b3d9-b1f770253151): created successfully Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68f4c82-b08b-4ac1-9f21-d17a5b28a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (d92953bf-0d93-4437-b12c-b12a39a96846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:53:52 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5441737c-4b7c-458a-af2d-f194b4dcccbf tempest-VolumesSnapshotTestJSON-890391627 None] Created volume successfully. Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:53 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 1073741824" returned: 0 in 0.633s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:53 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 Nov 02 17:53:53 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:53 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.431s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e8d22-3918-4008-b8c0-041c048c2c6c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43926633-099c-4e4b-8112-8e8c1476640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-692c1b3b-fba1-4209-b11a-53eb57947247', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f00010-1f67-420d-9d9b-4b0b1b34b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:53 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Volume volume-692c1b3b-fba1-4209-b11a-53eb57947247 (692c1b3b-fba1-4209-b11a-53eb57947247): created successfully Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f00010-1f67-420d-9d9b-4b0b1b34b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Flow 'volume_create_manager' (ceb041c7-9c5a-4e76-9857-207da0cda9c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:53:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9059f50e-e91c-4543-b5c1-59d015fe32ac tempest-AttachVolumeNegativeTest-1140225009 None] Created volume successfully. Nov 02 17:53:53 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:53:53 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:53:53 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.427s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:54 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[336e05d5-d67b-44af-b88c-6c93910ff0d7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:53:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:54 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:53:54 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:54 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Nov 02 17:53:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.417s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:53:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:53:54 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img Nov 02 17:53:54 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:53:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-8b9dd0ac-1165-4046-b5ab-f1faa98aad47 req-ba62eeb5-0e88-4454-8d47-79fc539e93db tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:04 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img" returned: 0 in 10.200s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea141717-daf2-4aef-b713-c62bfe97b754]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:04 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:54:04 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:05 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:DELETE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:54:05 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.789s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:05 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59, size 1024.00 MB, duration 10.20 sec, destination /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:54:05 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Converted 1024.00 MB image at 100.38 MB/s Nov 02 17:54:05 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] a2309b9f-5c16-4ddd-a34d-56513cd23c6d was raw, converting to qcow2 {{(pid=86585) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 17:54:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad629c53-f5dd-4896-a787-7375b2c01787]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:05 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img Nov 02 17:54:05 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:06 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img" returned: 0 in 0.837s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:06 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img Nov 02 17:54:06 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:06 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img" returned: 1 in 0.511s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:54:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img /opt/stack/data/cinder/conversion/vol_upload_lx0753fr {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:06 devstack sudo[95854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img /opt/stack/data/cinder/conversion/vol_upload_lx0753fr Nov 02 17:54:06 devstack sudo[95854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:07 devstack sudo[95854]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img /opt/stack/data/cinder/conversion/vol_upload_lx0753fr" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:07 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Image conversion details: src /opt/stack/data/cinder/conversion/b578f331-c2b1-4470-a075-6e54dc3b5f59.temp_image.a2309b9f-5c16-4ddd-a34d-56513cd23c6d5d5kr_05.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lx0753fr {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:54:07 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 17:54:07 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ad55fa-097f-434f-9d95-32906858d25c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lx0753fr {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:07 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lx0753fr Nov 02 17:54:07 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:07 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lx0753fr" returned: 0 in 0.409s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.534s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Uploaded volume to glance image-id: a2309b9f-5c16-4ddd-a34d-56513cd23c6d. {{(pid=86585) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 16.134s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Creating offline snapshot 12d0476f-3404-4d96-8d28-190885bd4293 of volume 4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:54:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b19e3c52-ca69-4c5a-a226-896233448fda tempest-VolumesActionsTest-2046848613 None] Copy volume to image completed successfully. Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ed10c-892b-4843-9c4f-03176da232b6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:10 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 Nov 02 17:54:10 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:10 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151" returned: 0 in 0.573s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:10 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 1G Nov 02 17:54:10 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "cinder-quobyte-b578f331-c2b1-4470-a075-6e54dc3b5f59" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-quobyte-b578f331-c2b1-4470-a075-6e54dc3b5f59" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cb102c-21f6-4e3b-92b0-ef180bcc5f41]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:11 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:11 devstack sudo[95936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:54:11 devstack sudo[95936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 1G" returned: 0 in 0.821s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:11 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 Nov 02 17:54:11 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:11 devstack sudo[95936]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.460s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:11 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59 Nov 02 17:54:11 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:11 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293" returned: 0 in 0.374s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:11 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 is being set with open permissions: ugo+rw Nov 02 17:54:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:12 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 Nov 02 17:54:12 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:12 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b578f331-c2b1-4470-a075-6e54dc3b5f59" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:12 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293" returned: 0 in 0.309s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-quobyte-b578f331-c2b1-4470-a075-6e54dc3b5f59" released by "delete_volume" :: held 0.882s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:12 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info Nov 02 17:54:12 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Created reservations ['963f530f-e256-46bc-9106-a3185bf7d90d', '51fa5bba-0422-4645-b534-c16fb8c23cf0', '3de81414-5cd9-400c-a451-64479a374413', '5b89285d-320e-4ef7-928e-b7faf1bca47f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:12 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:54:12 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:12 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:12 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info is being set with open permissions: ugo+rw Nov 02 17:54:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:12 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info Nov 02 17:54:12 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:13 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:54:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Deleted volume successfully. Nov 02 17:54:13 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b023d800-3d16-4859-a344-8628dafd2082 tempest-VolumesActionsTest-2046848613 None] Lock "cinder-b578f331-c2b1-4470-a075-6e54dc3b5f59-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.info" returned: 0 in 0.365s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.140s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-8b9dd0ac-1165-4046-b5ab-f1faa98aad47 req-ba62eeb5-0e88-4454-8d47-79fc539e93db tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.989s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-8b9dd0ac-1165-4046-b5ab-f1faa98aad47 req-ba62eeb5-0e88-4454-8d47-79fc539e93db tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-527415db-4917-45a7-a1e0-887e37672004 tempest-VolumesSnapshotTestJSON-890391627 None] Create snapshot completed successfully Nov 02 17:54:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-8b9dd0ac-1165-4046-b5ab-f1faa98aad47 req-ba62eeb5-0e88-4454-8d47-79fc539e93db tempest-AttachVolumeNegativeTest-1140225009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-692c1b3b-fba1-4209-b11a-53eb57947247', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da9daf8b-6c35-4e21-be53-c7ff660bedbd', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:54:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-8b9dd0ac-1165-4046-b5ab-f1faa98aad47 req-ba62eeb5-0e88-4454-8d47-79fc539e93db tempest-AttachVolumeNegativeTest-1140225009 None] attachment_update completed successfully. Nov 02 17:54:14 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:54:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (876a630d-5e9a-490a-a469-399626c342cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:54:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c8f868-621c-49f4-babd-4b4816d43c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c8f868-621c-49f4-babd-4b4816d43c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-50414442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f02bc8c-27db-471a-a026-8c8972af6951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab4505f07d914aa9ac2c66911f497d5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12d0476f-3404-4d96-8d28-190885bd4293,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:54:15Z,use_quota=True,user_id='4ddcb265882b4a7cbf560907ca86b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622aa9d8-a7a7-48a5-9b0d-0b6a221ea7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (622aa9d8-a7a7-48a5-9b0d-0b6a221ea7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f072a54-a2cf-4e70-81b7-1ad19737df98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f072a54-a2cf-4e70-81b7-1ad19737df98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f02bc8c-27db-471a-a026-8c8972af6951', 'volume_name': 'volume-8f02bc8c-27db-471a-a026-8c8972af6951', 'volume_size': 1, 'snapshot_id': '12d0476f-3404-4d96-8d28-190885bd4293'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcdba02-61a5-4da4-ba49-bc9cd3c42a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcdba02-61a5-4da4-ba49-bc9cd3c42a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b7fb7-2d0d-4987-bd55-7cd7a3bec1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Volume 8f02bc8c-27db-471a-a026-8c8972af6951: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f02bc8c-27db-471a-a026-8c8972af6951', 'volume_size': 1, 'snapshot_id': '12d0476f-3404-4d96-8d28-190885bd4293'} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-12d0476f-3404-4d96-8d28-190885bd4293-8f02bc8c-27db-471a-a026-8c8972af6951" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-12d0476f-3404-4d96-8d28-190885bd4293-8f02bc8c-27db-471a-a026-8c8972af6951" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Creating volume 8f02bc8c-27db-471a-a026-8c8972af6951 from snapshot 12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-8f02bc8c-27db-471a-a026-8c8972af6951" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-8f02bc8c-27db-471a-a026-8c8972af6951" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] snapshot: 12d0476f-3404-4d96-8d28-190885bd4293, volume: 8f02bc8c-27db-471a-a026-8c8972af6951, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55edf5-a9ac-4e79-9d2b-e0ef25555661]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:15 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 Nov 02 17:54:15 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:16 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293" returned: 0 in 0.976s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcb6113-81ab-4cab-b3d9-b1f770253151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e85216-1e05-4f30-bfe7-c920721fb04b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Flow 'volume_create_manager' (24b9e6ce-f8aa-4473-b6d5-a67298513bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f1c3b6-42ab-497c-93ab-d6df56132444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:16 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 Nov 02 17:54:16 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f1c3b6-42ab-497c-93ab-d6df56132444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-138883957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4117fa-4c3f-4757-8de5-99bfa7ec11a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a13f25a18aa4d04b3670b725c332f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:54:16Z,use_quota=True,user_id='b54e46d546b14eeca42c42bdc20bd398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669386d9-fc40-4f9a-8ba7-f9668aa2cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669386d9-fc40-4f9a-8ba7-f9668aa2cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4982a996-a31f-495d-8f24-7cbb0eebe7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4982a996-a31f-495d-8f24-7cbb0eebe7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4117fa-4c3f-4757-8de5-99bfa7ec11a5', 'volume_name': 'volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416e84a9-8539-4159-844f-10af161354bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (416e84a9-8539-4159-844f-10af161354bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d3ceb9-2140-4003-9284-0953a00ad3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Volume 1f4117fa-4c3f-4757-8de5-99bfa7ec11a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5', 'volume_size': 1} Nov 02 17:54:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:17 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151" returned: 0 in 1.041s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 17:54:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 17:54:17 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 17:54:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:17 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 Nov 02 17:54:17 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:26 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:54:26 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=27,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:54:29 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951" returned: 0 in 12.091s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151, size 1024.00 MB, duration 12.09 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:54:29 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Converted 1024.00 MB image at 84.67 MB/s Nov 02 17:54:29 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 is being set with open permissions: ugo+rw Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:29 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 Nov 02 17:54:29 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:29 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951" returned: 0 in 0.383s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-8f02bc8c-27db-471a-a026-8c8972af6951" released by "_copy_volume_from_snapshot" :: held 14.739s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-12d0476f-3404-4d96-8d28-190885bd4293-8f02bc8c-27db-471a-a026-8c8972af6951" released by "_create_volume_from_snapshot" :: held 14.844s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.881s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.113s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-138883957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4117fa-4c3f-4757-8de5-99bfa7ec11a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a13f25a18aa4d04b3670b725c332f52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:54:16Z,use_quota=True,user_id='b54e46d546b14eeca42c42bdc20bd398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Creating volume 1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:54:29 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:54:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:30 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 1073741824 Nov 02 17:54:30 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044b7fb7-2d0d-4987-bd55-7cd7a3bec1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f02bc8c-27db-471a-a026-8c8972af6951', 'volume_size': 1, 'snapshot_id': '12d0476f-3404-4d96-8d28-190885bd4293'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24e7a0b-3fde-4cd0-a777-2eb43e57c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Volume volume-8f02bc8c-27db-471a-a026-8c8972af6951 (8f02bc8c-27db-471a-a026-8c8972af6951): created successfully Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24e7a0b-3fde-4cd0-a777-2eb43e57c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Flow 'volume_create_manager' (876a630d-5e9a-490a-a469-399626c342cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:54:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-67720797-6707-4eb2-bf6d-a681db65e5b4 tempest-VolumesSnapshotTestJSON-890391627 None] Created volume successfully. Nov 02 17:54:30 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 1073741824" returned: 0 in 0.592s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:30 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 Nov 02 17:54:30 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-8f02bc8c-27db-471a-a026-8c8972af6951-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-8f02bc8c-27db-471a-a026-8c8972af6951-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-8f02bc8c-27db-471a-a026-8c8972af6951" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-8f02bc8c-27db-471a-a026-8c8972af6951" acquired by "delete_volume" :: waited 0.042s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc13d9-1dc8-4081-a778-082ce072b346]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:31 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5" returned: 0 in 0.532s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d3ceb9-2140-4003-9284-0953a00ad3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389b8a9c-c2c3-4ec9-ab26-10f8d054bec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:54:31 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Volume volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 (1f4117fa-4c3f-4757-8de5-99bfa7ec11a5): created successfully Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389b8a9c-c2c3-4ec9-ab26-10f8d054bec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Flow 'volume_create_manager' (24b9e6ce-f8aa-4473-b6d5-a67298513bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:54:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b47a7059-8eac-4488-9961-fe03b5d1ade0 tempest-ServerRescueNegativeTestJSON-947157822 None] Created volume successfully. Nov 02 17:54:31 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 Nov 02 17:54:31 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:31 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951" returned: 0 in 0.478s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:31 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951 Nov 02 17:54:31 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:31 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8f02bc8c-27db-471a-a026-8c8972af6951" returned: 0 in 0.323s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-8f02bc8c-27db-471a-a026-8c8972af6951" released by "delete_volume" :: held 0.884s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['444c7135-5f8b-4dcb-9665-ff24120b856a', '37920b40-73f4-4353-88e5-614a025dcd44', '7a134d9f-cf13-45ef-92c1-0d52383eaf43', 'b49eeffe-9fb7-422d-8214-0796188f70ac'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:32 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:54:32 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:32 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.483s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:54:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Deleted volume successfully. Nov 02 17:54:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7174c0b5-582a-49ba-b217-37086155222a tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-8f02bc8c-27db-471a-a026-8c8972af6951-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-12d0476f-3404-4d96-8d28-190885bd4293-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-12d0476f-3404-4d96-8d28-190885bd4293-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-4bcb6113-81ab-4cab-b3d9-b1f770253151" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4bcb6113-81ab-4cab-b3d9-b1f770253151" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-12d0476f-3404-4d96-8d28-190885bd4293" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-12d0476f-3404-4d96-8d28-190885bd4293" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Deleting offline snapshot 12d0476f-3404-4d96-8d28-190885bd4293 of volume 4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] snapshot_file for this snap is: volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9213b6e-8ba2-4778-918b-bb39a9699ec8]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:33 devstack sudo[96594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 Nov 02 17:54:33 devstack sudo[96594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:34 devstack sudo[96594]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293" returned: 0 in 0.855s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bcb6113-81ab-4cab-b3d9-b1f770253151(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:54:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[688e3e75-2dc6-49df-95ed-987bf84063df]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:34 devstack sudo[96602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 Nov 02 17:54:34 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:35 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151" returned: 0 in 1.037s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:35 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 Nov 02 17:54:35 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:36 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293" returned: 0 in 0.674s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:36 devstack sudo[96623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293 Nov 02 17:54:36 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:36 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151.12d0476f-3404-4d96-8d28-190885bd4293" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-12d0476f-3404-4d96-8d28-190885bd4293" released by "_delete_snapshot" :: held 3.430s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4bcb6113-81ab-4cab-b3d9-b1f770253151" released by "delete_snapshot" :: held 3.482s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['a70eeedf-7ab2-4c34-84f0-f08211dacb10', 'aad7fe53-deda-467d-a4eb-cf26061f9770', '1f4de859-40fc-44f7-8612-cea89e37ccad', '89093039-7e5c-4fa3-91e0-721fa95f8201'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:54:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Delete snapshot completed successfully. Nov 02 17:54:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-913e517c-eaef-490a-a973-90c42aeec6be tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-12d0476f-3404-4d96-8d28-190885bd4293-delete_snapshot" released by "delete_snapshot" :: held 3.810s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-4bcb6113-81ab-4cab-b3d9-b1f770253151-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-4bcb6113-81ab-4cab-b3d9-b1f770253151-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-4bcb6113-81ab-4cab-b3d9-b1f770253151" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4bcb6113-81ab-4cab-b3d9-b1f770253151" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[24627e6e-ab95-4bd5-9693-5ecf4a379e91]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:38 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 Nov 02 17:54:38 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:39 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151" returned: 0 in 0.922s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:39 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151 Nov 02 17:54:39 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:39 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bcb6113-81ab-4cab-b3d9-b1f770253151" returned: 0 in 0.604s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4bcb6113-81ab-4cab-b3d9-b1f770253151" released by "delete_volume" :: held 1.681s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['aaa2b266-64f7-4772-8537-ee5eb2854e12', 'ef0602d5-c184-43b7-96ca-116a834ba994', 'fa648590-b4dd-4e7c-af68-cf4eab600052', '0c7b26ca-3fe2-4879-a7fa-0337d7714e7c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:40 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:54:40 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-4142dbb5-ccdc-4471-abba-857a2a205e7b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-4142dbb5-ccdc-4471-abba-857a2a205e7b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "cinder-quobyte-4142dbb5-ccdc-4471-abba-857a2a205e7b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4142dbb5-ccdc-4471-abba-857a2a205e7b" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c4ea9-f9db-470c-981b-bd9d96eccdcd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:41 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.731s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:54:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Deleted volume successfully. Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cd96d8cf-5248-40d0-9bf2-2c0641a64079 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-4bcb6113-81ab-4cab-b3d9-b1f770253151-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:41 devstack sudo[96664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b Nov 02 17:54:41 devstack sudo[96664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:41 devstack sudo[96664]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b" returned: 0 in 0.563s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:41 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b Nov 02 17:54:41 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:42 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4142dbb5-ccdc-4471-abba-857a2a205e7b" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-quobyte-4142dbb5-ccdc-4471-abba-857a2a205e7b" released by "delete_volume" :: held 1.166s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Created reservations ['e86bad79-fdec-45f4-a433-a0de73e5a6e9', 'e58a56d9-19d9-4ef3-833d-7328b33ae951', '6b925052-5d0f-4a87-9a3a-ce6d295583bc', '34efce19-635c-408f-bd11-2874995df424'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:42 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:54:42 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:42 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.437s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:54:42 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Deleted volume successfully. Nov 02 17:54:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0cbf56c6-0978-445f-b914-36a193dd0050 tempest-VolumesSnapshotTestJSON-890391627 None] Lock "cinder-4142dbb5-ccdc-4471-abba-857a2a205e7b-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:46 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:54:46 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:47 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.454s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:54:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:54:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:54:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:54:52 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=36,cinder:INSERT=8,cinder:SELECT=20,cinder:DELETE=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:54:52 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:54:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Acquiring lock "cinder-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "cinder-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Acquiring lock "cinder-quobyte-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:54:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "cinder-quobyte-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:54:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb2e13-8d6e-4ce6-9c03-34a20b6a7bed]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:54:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:56 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 Nov 02 17:54:56 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:56 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5" returned: 0 in 0.582s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:56 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5 Nov 02 17:54:56 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:56 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "cinder-quobyte-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5" released by "delete_volume" :: held 1.053s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Created reservations ['0080b68b-9970-4f44-a93b-546c7f9afebe', '45648ab4-da11-40d8-9d19-8fa94079d37e', 'd8454e61-98e0-4645-bdeb-621c769ed3a0', '648c0c64-5cb3-43ac-9ee3-6b9e713ba126'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:54:57 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:54:57 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:54:57 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.394s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:54:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Deleted volume successfully. Nov 02 17:54:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f18cfb46-ea92-47e8-9000-379ef9a399e9 tempest-ServerRescueNegativeTestJSON-947157822 None] Lock "cinder-1f4117fa-4c3f-4757-8de5-99bfa7ec11a5-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:07 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:55:07 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:55:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-c03616aa-68e5-4b32-afe0-0759a2e009bf req-ff433cb5-8643-46bf-a6ff-da18fedd037c tempest-AttachVolumeNegativeTest-1140225009 None] Terminate volume connection completed successfully. Nov 02 17:55:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-c03616aa-68e5-4b32-afe0-0759a2e009bf req-ff433cb5-8643-46bf-a6ff-da18fedd037c tempest-AttachVolumeNegativeTest-1140225009 None] Deleting attachment da9daf8b-6c35-4e21-be53-c7ff660bedbd. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Flow 'volume_create_manager' (30e247ba-9ce1-4913-ae59-a4c4ecced7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75054384-73ff-47d9-9663-fd9e6cd04825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75054384-73ff-47d9-9663-fd9e6cd04825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-68617761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d033b3-25c2-44e5-aaf4-13c0fe14d348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aaf7e3ffa441c1a0a986c0ffa6d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:14Z,use_quota=True,user_id='f139c66551e24f56aab56f8ffbf4545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28e6e0c-08a9-44ce-a5be-bfd3058531f6),volume_type_id=b28e6e0c-08a9-44ce-a5be-bfd3058531f6)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e2dc35-e24a-4fc5-994f-1097a8f7d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e2dc35-e24a-4fc5-994f-1097a8f7d108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40ca593-977a-45ed-a9a7-f8ec459437d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c40ca593-977a-45ed-a9a7-f8ec459437d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d033b3-25c2-44e5-aaf4-13c0fe14d348', 'volume_name': 'volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f68f1e6-c089-4794-8905-615c2024e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f68f1e6-c089-4794-8905-615c2024e13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea38bb84-eeca-43fb-ac51-652fd1499351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume e6d033b3-25c2-44e5-aaf4-13c0fe14d348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348', 'volume_size': 1} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-68617761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d033b3-25c2-44e5-aaf4-13c0fe14d348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aaf7e3ffa441c1a0a986c0ffa6d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:14Z,use_quota=True,user_id='f139c66551e24f56aab56f8ffbf4545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b28e6e0c-08a9-44ce-a5be-bfd3058531f6),volume_type_id=b28e6e0c-08a9-44ce-a5be-bfd3058531f6)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Creating volume e6d033b3-25c2-44e5-aaf4-13c0fe14d348 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:14 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:14 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 1073741824 Nov 02 17:55:14 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Flow 'volume_create_manager' (846a1e3f-36ed-40bd-9d11-5e9a7198f3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614d7265-2944-49d9-bfe4-b200a29b7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614d7265-2944-49d9-bfe4-b200a29b7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1553021907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e9e93f-1e94-478a-a054-05a57d108f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aaf7e3ffa441c1a0a986c0ffa6d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:15Z,use_quota=True,user_id='f139c66551e24f56aab56f8ffbf4545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce8e17b-c3f6-4e27-9403-c988e7951416),volume_type_id=2ce8e17b-c3f6-4e27-9403-c988e7951416)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d1a275-3247-44fd-98c6-455f1e2525be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2d1a275-3247-44fd-98c6-455f1e2525be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3610c391-4129-4e39-b56a-9c97a7d44be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3610c391-4129-4e39-b56a-9c97a7d44be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e9e93f-1e94-478a-a054-05a57d108f17', 'volume_name': 'volume-e1e9e93f-1e94-478a-a054-05a57d108f17', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7831f45-b3c8-44c6-956c-3d86834ad8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7831f45-b3c8-44c6-956c-3d86834ad8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c6c7f3-4ec7-4720-a988-bf2becac17d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:14 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume e1e9e93f-1e94-478a-a054-05a57d108f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e9e93f-1e94-478a-a054-05a57d108f17', 'volume_size': 1} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:14 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 1073741824" returned: 0 in 0.756s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:14 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 Nov 02 17:55:14 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:15 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348" returned: 0 in 0.434s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1553021907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e9e93f-1e94-478a-a054-05a57d108f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aaf7e3ffa441c1a0a986c0ffa6d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:15Z,use_quota=True,user_id='f139c66551e24f56aab56f8ffbf4545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ce8e17b-c3f6-4e27-9403-c988e7951416),volume_type_id=2ce8e17b-c3f6-4e27-9403-c988e7951416)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Creating volume e1e9e93f-1e94-478a-a054-05a57d108f17 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:15 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea38bb84-eeca-43fb-ac51-652fd1499351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05efadd1-b9ae-4fd4-9883-1fda71b45f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:15 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 1073741824 Nov 02 17:55:15 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 (e6d033b3-25c2-44e5-aaf4-13c0fe14d348): created successfully Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05efadd1-b9ae-4fd4-9883-1fda71b45f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Flow 'volume_create_manager' (30e247ba-9ce1-4913-ae59-a4c4ecced7e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7dfd2e50-2c1e-44fd-ba8c-6ec6b25c14a6 tempest-TestInstancesWithCinderVolumes-1954485388 None] Created volume successfully. Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Flow 'volume_create_manager' (937f39c2-2bb1-4d3f-ac47-8f64749fd904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56014301-8afe-41c3-9fef-62c9a46f59f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56014301-8afe-41c3-9fef-62c9a46f59f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-593550117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7680e29-2640-422d-b7ec-740ee59dbfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aaf7e3ffa441c1a0a986c0ffa6d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:15Z,use_quota=True,user_id='f139c66551e24f56aab56f8ffbf4545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49c7a277-4560-4d0d-af72-2736286c1b56),volume_type_id=49c7a277-4560-4d0d-af72-2736286c1b56)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438ed5b-9451-4871-bec1-dbcdf66b2c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f438ed5b-9451-4871-bec1-dbcdf66b2c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8982f2-639c-474e-9867-95855607f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 17:55:15 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 1073741824" returned: 0 in 0.655s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8982f2-639c-474e-9867-95855607f00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd7680e29-2640-422d-b7ec-740ee59dbfa9', 'volume_name': 'volume-d7680e29-2640-422d-b7ec-740ee59dbfa9', 'volume_size': 1, 'image_id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2102208075', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6aaf7e3ffa441c1a0a986c0ffa6d7ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'created_at': datetime.datetime(2026, 11, 2, 16, 55, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 55, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1/file', 'properties': {}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5864f5ec-024d-424a-b232-6e867d04089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5864f5ec-024d-424a-b232-6e867d04089c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e24ff6-8791-46a0-90cd-2ce457e58c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume d7680e29-2640-422d-b7ec-740ee59dbfa9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d7680e29-2640-422d-b7ec-740ee59dbfa9', 'volume_size': 1, 'image_id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2102208075', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6aaf7e3ffa441c1a0a986c0ffa6d7ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'created_at': datetime.datetime(2026, 11, 2, 16, 55, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 55, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1/file', 'properties': {}}, 'image_service': } Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Trying to clone d7680e29-2640-422d-b7ec-740ee59dbfa9 from image 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:16 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 Nov 02 17:55:16 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:16 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17" returned: 0 in 0.371s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c6c7f3-4ec7-4720-a988-bf2becac17d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e9e93f-1e94-478a-a054-05a57d108f17', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d908ca6d-94c3-4235-93ac-49cd6c2873d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume volume-e1e9e93f-1e94-478a-a054-05a57d108f17 (e1e9e93f-1e94-478a-a054-05a57d108f17): created successfully Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d908ca6d-94c3-4235-93ac-49cd6c2873d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Flow 'volume_create_manager' (846a1e3f-36ed-40bd-9d11-5e9a7198f3b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6c657f97-2046-40d0-a13c-24dce2b9c685 tempest-TestInstancesWithCinderVolumes-1954485388 None] Created volume successfully. Nov 02 17:55:20 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD, size 20.69 MB, duration 4.37 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 17:55:20 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Image download 20.69 MB at 4.73 MB/s Nov 02 17:55:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e51fc9-e6e6-4a52-9c0a-4756e20f40ea]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:20 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD Nov 02 17:55:20 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:20 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:20 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Temporary image 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 is fetched for user f139c66551e24f56aab56f8ffbf4545e. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f84482a-930f-45c9-95e3-b144ad83f24b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:21 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD Nov 02 17:55:21 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:21 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-593550117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7680e29-2640-422d-b7ec-740ee59dbfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aaf7e3ffa441c1a0a986c0ffa6d7ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:15Z,use_quota=True,user_id='f139c66551e24f56aab56f8ffbf4545e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49c7a277-4560-4d0d-af72-2736286c1b56),volume_type_id=49c7a277-4560-4d0d-af72-2736286c1b56)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Creating volume d7680e29-2640-422d-b7ec-740ee59dbfa9 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:21 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:21 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 1073741824 Nov 02 17:55:21 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:22 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 1073741824" returned: 0 in 0.650s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:22 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 Nov 02 17:55:22 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:22 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9" returned: 0 in 0.355s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Attempting download of 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'metadata': {}}])) to volume d7680e29-2640-422d-b7ec-740ee59dbfa9. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4381eb8d-517a-4531-8c03-f3a3734789e1]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:22 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd Nov 02 17:55:22 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:23 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd" returned: 0 in 0.396s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:23 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd Nov 02 17:55:23 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:23 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd" returned: 1 in 0.414s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_dx3pm9pd' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec4615a-3e74-49e6-9fef-30c7f64f46ce]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:23 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD Nov 02 17:55:23 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:23 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 was qcow2, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 17:55:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:23 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 Nov 02 17:55:23 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Flow 'volume_create_manager' (5715f2cd-c6d2-4265-b08e-be397b88c991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc6cc95-43d2-482f-8ded-0b91447773f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc6cc95-43d2-482f-8ded-0b91447773f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-851059668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506c6737-8db2-471e-8e97-9b017fa6233b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b84b827e7c9c4d00869def458463d29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:24Z,use_quota=True,user_id='2c73ec665f2c4e69825309da9dd8c183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d9b75-d266-4264-8fbf-db8a2f9b6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d9b75-d266-4264-8fbf-db8a2f9b6454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23df3987-1fba-4bdd-af33-af7e6c5e2488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23df3987-1fba-4bdd-af33-af7e6c5e2488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '506c6737-8db2-471e-8e97-9b017fa6233b', 'volume_name': 'volume-506c6737-8db2-471e-8e97-9b017fa6233b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea774ba-da48-4067-902a-cdc419106b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ea774ba-da48-4067-902a-cdc419106b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d79e81-2ad4-4951-947d-70bbb53f4de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Volume 506c6737-8db2-471e-8e97-9b017fa6233b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-506c6737-8db2-471e-8e97-9b017fa6233b', 'volume_size': 1} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-851059668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=506c6737-8db2-471e-8e97-9b017fa6233b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b84b827e7c9c4d00869def458463d29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:24Z,use_quota=True,user_id='2c73ec665f2c4e69825309da9dd8c183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Creating volume 506c6737-8db2-471e-8e97-9b017fa6233b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:24 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:24 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b 1073741824 Nov 02 17:55:24 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:24 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b 1073741824" returned: 0 in 0.609s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:25 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b Nov 02 17:55:25 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:25 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b" returned: 0 in 0.400s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d79e81-2ad4-4951-947d-70bbb53f4de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-506c6737-8db2-471e-8e97-9b017fa6233b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e07d429-950c-4fe0-8117-e2c466bb5003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Volume volume-506c6737-8db2-471e-8e97-9b017fa6233b (506c6737-8db2-471e-8e97-9b017fa6233b): created successfully Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e07d429-950c-4fe0-8117-e2c466bb5003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Flow 'volume_create_manager' (5715f2cd-c6d2-4265-b08e-be397b88c991) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f7819503-0c9d-4fc6-969f-a9c931d21a93 tempest-VolumesTestJSON-1324291462 None] Created volume successfully. Nov 02 17:55:26 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9" returned: 0 in 2.448s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1_c7o8s8agdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:55:26 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Converted 112.00 MB image at 45.74 MB/s Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:26 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 1G Nov 02 17:55:26 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:26 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 1G" returned: 0 in 0.572s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Downloaded image 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'metadata': {}}])) to volume d7680e29-2640-422d-b7ec-740ee59dbfa9 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Temporary image 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 for user f139c66551e24f56aab56f8ffbf4545e is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 17:55:26 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Marking volume d7680e29-2640-422d-b7ec-740ee59dbfa9 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Copying metadata from image 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 to d7680e29-2640-422d-b7ec-740ee59dbfa9. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Creating volume glance metadata for volume d7680e29-2640-422d-b7ec-740ee59dbfa9 backed by image 3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1 with: {'image_id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'image_name': 'tempest-scenario-img--2102208075', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e24ff6-8791-46a0-90cd-2ce457e58c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7680e29-2640-422d-b7ec-740ee59dbfa9', 'volume_size': 1, 'image_id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2102208075', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b6aaf7e3ffa441c1a0a986c0ffa6d7ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1', 'created_at': datetime.datetime(2026, 11, 2, 16, 55, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 55, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b25bbbe-18b2-4b23-b79d-6ab9a8f4d3f1/file', 'properties': {}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f394ce-cd6c-4918-a528-17fee8fce061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Volume volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 (d7680e29-2640-422d-b7ec-740ee59dbfa9): created successfully Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62f394ce-cd6c-4918-a528-17fee8fce061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Flow 'volume_create_manager' (937f39c2-2bb1-4d3f-ac47-8f64749fd904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5e6395c9-6d3a-433b-8c6a-354c12a23b01 tempest-TestInstancesWithCinderVolumes-1954485388 None] Created volume successfully. Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Flow 'volume_create_manager' (0fc50c5b-90f2-4dbe-9406-c510eb7e9b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da316a8-4878-4488-9be0-5af4a0b56dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da316a8-4878-4488-9be0-5af4a0b56dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-844713937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d1708e-90cd-4655-bdfa-5b81f8c8454d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b84b827e7c9c4d00869def458463d29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:27Z,use_quota=True,user_id='2c73ec665f2c4e69825309da9dd8c183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10311c1b-fae9-4fc8-a6e6-8ac8e88012e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10311c1b-fae9-4fc8-a6e6-8ac8e88012e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a738c5c-7049-40af-ba7a-f419c2564871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a738c5c-7049-40af-ba7a-f419c2564871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d1708e-90cd-4655-bdfa-5b81f8c8454d', 'volume_name': 'volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e8161a-4427-4a79-985f-d99dce01b087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e8161a-4427-4a79-985f-d99dce01b087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67da9486-4175-40ba-89ac-ea4860e8a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Volume e2d1708e-90cd-4655-bdfa-5b81f8c8454d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d', 'volume_size': 1} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-844713937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d1708e-90cd-4655-bdfa-5b81f8c8454d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b84b827e7c9c4d00869def458463d29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:27Z,use_quota=True,user_id='2c73ec665f2c4e69825309da9dd8c183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Creating volume e2d1708e-90cd-4655-bdfa-5b81f8c8454d {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:27 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d 1073741824 Nov 02 17:55:27 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:28 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d 1073741824" returned: 0 in 0.772s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:28 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d Nov 02 17:55:28 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:28 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d" returned: 0 in 0.366s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67da9486-4175-40ba-89ac-ea4860e8a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecb55be-f5be-485b-b8e3-2001c04ac57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Volume volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d (e2d1708e-90cd-4655-bdfa-5b81f8c8454d): created successfully Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ecb55be-f5be-485b-b8e3-2001c04ac57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Flow 'volume_create_manager' (0fc50c5b-90f2-4dbe-9406-c510eb7e9b7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e5c2c7e7-eac5-4bac-95f9-d7855973d06f tempest-VolumesTestJSON-1324291462 None] Created volume successfully. Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Flow 'volume_create_manager' (8bb82a0d-6bc8-407e-9dee-c496428e5588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e37e1ff-8dc7-4d5c-ad86-d3dd94be1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e37e1ff-8dc7-4d5c-ad86-d3dd94be1870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1487683748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02bd880-8b78-4283-901b-914e3720a53e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b84b827e7c9c4d00869def458463d29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:33Z,use_quota=True,user_id='2c73ec665f2c4e69825309da9dd8c183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c634d1ae-2ac3-453d-831b-0e4db8c46a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c634d1ae-2ac3-453d-831b-0e4db8c46a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd62981d-b5ae-46cf-bff7-5e713f56d3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd62981d-b5ae-46cf-bff7-5e713f56d3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02bd880-8b78-4283-901b-914e3720a53e', 'volume_name': 'volume-e02bd880-8b78-4283-901b-914e3720a53e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa101ab-e140-4502-94ce-cc3a9cd46bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa101ab-e140-4502-94ce-cc3a9cd46bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8b35ee-69cb-4388-b6e3-b2ba0d935a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:33 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Volume e02bd880-8b78-4283-901b-914e3720a53e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02bd880-8b78-4283-901b-914e3720a53e', 'volume_size': 1} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1487683748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02bd880-8b78-4283-901b-914e3720a53e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b84b827e7c9c4d00869def458463d29b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:33Z,use_quota=True,user_id='2c73ec665f2c4e69825309da9dd8c183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Creating volume e02bd880-8b78-4283-901b-914e3720a53e {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:33 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:33 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e 1073741824 Nov 02 17:55:33 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:34 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e 1073741824" returned: 0 in 1.062s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:34 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e Nov 02 17:55:34 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:35 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e" returned: 0 in 0.634s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df8b35ee-69cb-4388-b6e3-b2ba0d935a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02bd880-8b78-4283-901b-914e3720a53e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1512e9b7-1867-498d-8818-e47c7ffd5c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Volume volume-e02bd880-8b78-4283-901b-914e3720a53e (e02bd880-8b78-4283-901b-914e3720a53e): created successfully Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1512e9b7-1867-498d-8818-e47c7ffd5c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Flow 'volume_create_manager' (8bb82a0d-6bc8-407e-9dee-c496428e5588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-335f9f25-e729-463a-95d1-ae3d564a8e01 tempest-VolumesTestJSON-1324291462 None] Created volume successfully. Nov 02 17:55:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-bed76bbc-6709-4923-97b7-ad3e4a9a4cf5 req-3b464ddb-25cf-42ca-83f4-b468dea612a9 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-bed76bbc-6709-4923-97b7-ad3e4a9a4cf5 req-3b464ddb-25cf-42ca-83f4-b468dea612a9 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-bed76bbc-6709-4923-97b7-ad3e4a9a4cf5 req-3b464ddb-25cf-42ca-83f4-b468dea612a9 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-bed76bbc-6709-4923-97b7-ad3e4a9a4cf5 req-3b464ddb-25cf-42ca-83f4-b468dea612a9 tempest-TestInstancesWithCinderVolumes-1954485388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-d7680e29-2640-422d-b7ec-740ee59dbfa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a75dc2bf-9139-40ea-ade9-528c73998aba', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:55:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-bed76bbc-6709-4923-97b7-ad3e4a9a4cf5 req-3b464ddb-25cf-42ca-83f4-b468dea612a9 tempest-TestInstancesWithCinderVolumes-1954485388 None] attachment_update completed successfully. Nov 02 17:55:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "cinder-e02bd880-8b78-4283-901b-914e3720a53e-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:55:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-e02bd880-8b78-4283-901b-914e3720a53e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:55:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "cinder-quobyte-e02bd880-8b78-4283-901b-914e3720a53e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:55:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-quobyte-e02bd880-8b78-4283-901b-914e3720a53e" acquired by "delete_volume" :: waited 0.042s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:55:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[486c1257-d179-4684-a332-dbb08b40fd1d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:39 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e Nov 02 17:55:39 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:39 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e" returned: 0 in 0.525s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:39 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e Nov 02 17:55:39 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Flow 'volume_create_manager' (c470fe38-78b5-4982-83cb-f100a9c24c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0319783f-616a-4c48-8777-1910a5d2105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0319783f-616a-4c48-8777-1910a5d2105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1390130766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cbe83a-d944-4395-abfc-016b7112f04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910bdbfed15749819ddd89f2931f2aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:39Z,use_quota=True,user_id='47747333ac9842b58aade36d35c678c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2404c56a-5740-4310-8d7d-89a96dcb1b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2404c56a-5740-4310-8d7d-89a96dcb1b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504ca106-6424-461e-a439-db1a7f6940f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 17:55:39 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e02bd880-8b78-4283-901b-914e3720a53e" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-quobyte-e02bd880-8b78-4283-901b-914e3720a53e" released by "delete_volume" :: held 0.986s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:39 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Created reservations ['781eef6a-0828-4e1c-be94-ddede0a21603', '5c4393be-bfd1-4f6f-a78e-7ce8ab67222c', 'db4f74f5-a49a-41a3-a683-f8692ec7f5fd', 'eb41cf4a-3a8c-4480-ae40-ea171be5ebbd'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:40 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:55:40 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504ca106-6424-461e-a439-db1a7f6940f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8cbe83a-d944-4395-abfc-016b7112f04b', 'volume_name': 'volume-b8cbe83a-d944-4395-abfc-016b7112f04b', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074db236-8bf1-4671-b470-43ee450d5717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074db236-8bf1-4671-b470-43ee450d5717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd91111b-69bb-4a2a-9b2f-9a094b450361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Volume b8cbe83a-d944-4395-abfc-016b7112f04b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8cbe83a-d944-4395-abfc-016b7112f04b', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Trying to clone b8cbe83a-d944-4395-abfc-016b7112f04b from image 789043a6-2392-4529-ac6f-09077d7c12df at location (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 17:55:40 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.802s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:40 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:55:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Deleted volume successfully. Nov 02 17:55:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-27db4809-f15a-44c6-bc4c-6b6f117708f4 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-e02bd880-8b78-4283-901b-914e3720a53e-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Acquiring lock "cinder-e2d1708e-90cd-4655-bdfa-5b81f8c8454d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:55:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Lock "cinder-e2d1708e-90cd-4655-bdfa-5b81f8c8454d-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:55:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Acquiring lock "cinder-quobyte-e2d1708e-90cd-4655-bdfa-5b81f8c8454d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:55:41 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD, size 20.69 MB, duration 1.31 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 17:55:41 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Image download 20.69 MB at 15.82 MB/s Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Lock "cinder-quobyte-e2d1708e-90cd-4655-bdfa-5b81f8c8454d" acquired by "delete_volume" :: waited 0.110s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71f0710-399e-45c0-9ab4-cfedca90ee7e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acfc6b0-c94e-425c-a449-47a759fbcc72]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:42 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD Nov 02 17:55:42 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:42 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d Nov 02 17:55:42 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:42 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD" returned: 0 in 0.629s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:42 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df is fetched for user 47747333ac9842b58aade36d35c678c2. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15e2b6-e8f1-4895-9e46-8db80d197bd2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:43 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d" returned: 0 in 1.053s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:43 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d Nov 02 17:55:43 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:43 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD Nov 02 17:55:43 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:43 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD" returned: 0 in 0.676s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1390130766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cbe83a-d944-4395-abfc-016b7112f04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910bdbfed15749819ddd89f2931f2aff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:55:39Z,use_quota=True,user_id='47747333ac9842b58aade36d35c678c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Creating volume b8cbe83a-d944-4395-abfc-016b7112f04b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:55:43 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:55:43 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e2d1708e-90cd-4655-bdfa-5b81f8c8454d" returned: 0 in 0.639s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:43 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b 1073741824 Nov 02 17:55:43 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Lock "cinder-quobyte-e2d1708e-90cd-4655-bdfa-5b81f8c8454d" released by "delete_volume" :: held 1.869s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Created reservations ['1113e298-24f5-442c-9e0f-bf7e2c53c297', '84d0f8e6-ff68-4aa9-a3d9-4343cefae543', '29900fd9-0592-4d03-bd93-ab9e30de38b6', 'ad184c9c-b2f4-4880-a276-99989f427fe7'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:44 devstack sudo[98082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:55:44 devstack sudo[98082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:44 devstack sudo[98082]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.387s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:55:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Deleted volume successfully. Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9e7eceb2-65eb-4d58-95e6-325395d5766a tempest-VolumesTestJSON-1324291462 None] Lock "cinder-e2d1708e-90cd-4655-bdfa-5b81f8c8454d-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:44 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b 1073741824" returned: 0 in 1.042s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:44 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b Nov 02 17:55:44 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "cinder-506c6737-8db2-471e-8e97-9b017fa6233b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-506c6737-8db2-471e-8e97-9b017fa6233b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:55:45 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b" returned: 0 in 0.508s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "cinder-quobyte-506c6737-8db2-471e-8e97-9b017fa6233b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Attempting download of 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume b8cbe83a-d944-4395-abfc-016b7112f04b. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-quobyte-506c6737-8db2-471e-8e97-9b017fa6233b" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa03d884-1e10-4e95-b501-fce355726c24]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d2aadd-6cc7-48ea-8633-94da350deb89]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:45 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b Nov 02 17:55:45 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:45 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j Nov 02 17:55:45 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:46 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b" returned: 0 in 0.595s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:46 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b Nov 02 17:55:46 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:46 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j" returned: 0 in 0.643s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:46 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j Nov 02 17:55:46 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:46 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:55:46 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:46 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-506c6737-8db2-471e-8e97-9b017fa6233b" returned: 0 in 0.585s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-quobyte-506c6737-8db2-471e-8e97-9b017fa6233b" released by "delete_volume" :: held 1.292s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Created reservations ['1601cef9-599f-4a5b-b1b7-755a903b2a6f', 'e7b24dc4-4ab2-4548-9a26-37f83c9c8422', '2974bf8d-8b92-4e4b-83c8-db28ebfb0880', '875c6f0e-9767-4c20-9488-fe4788e0237c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:47 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:55:47 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:47 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j" returned: 1 in 0.862s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_wz2pbv7j' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ee09ff-6232-411a-aa08-7616f0e2b13e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:47 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.581s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:55:47 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD Nov 02 17:55:47 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:47 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.461s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:55:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Deleted volume successfully. Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9df4819e-70e9-400d-930f-3f81577ec063 tempest-VolumesTestJSON-1324291462 None] Lock "cinder-506c6737-8db2-471e-8e97-9b017fa6233b-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:55:47 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] 789043a6-2392-4529-ac6f-09077d7c12df was qcow2, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 17:55:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:47 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b Nov 02 17:55:47 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:50 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b" returned: 0 in 3.016s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:50 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_3g_hlu3odevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:55:50 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Converted 112.00 MB image at 37.12 MB/s Nov 02 17:55:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:55:50 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b 1G Nov 02 17:55:50 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:55:51 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b 1G" returned: 0 in 0.560s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Downloaded image 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume b8cbe83a-d944-4395-abfc-016b7112f04b successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df for user 47747333ac9842b58aade36d35c678c2 is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Marking volume b8cbe83a-d944-4395-abfc-016b7112f04b as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Copying metadata from image 789043a6-2392-4529-ac6f-09077d7c12df to b8cbe83a-d944-4395-abfc-016b7112f04b. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Creating volume glance metadata for volume b8cbe83a-d944-4395-abfc-016b7112f04b backed by image 789043a6-2392-4529-ac6f-09077d7c12df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd91111b-69bb-4a2a-9b2f-9a094b450361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cbe83a-d944-4395-abfc-016b7112f04b', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ed9b89-c406-4533-9d6a-0359d1c117c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:55:51 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Volume volume-b8cbe83a-d944-4395-abfc-016b7112f04b (b8cbe83a-d944-4395-abfc-016b7112f04b): created successfully Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8ed9b89-c406-4533-9d6a-0359d1c117c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:55:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Flow 'volume_create_manager' (c470fe38-78b5-4982-83cb-f100a9c24c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:55:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9293f477-aa04-4c4d-9bbe-00300c3e6594 tempest-TestShelveInstance-2055589282 None] Created volume successfully. Nov 02 17:55:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-fd6e25d3-c315-4966-9084-ca102057ca04 req-3aa638ad-7844-4ff0-8421-7bf884793c15 tempest-TestShelveInstance-2055589282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:55:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-fd6e25d3-c315-4966-9084-ca102057ca04 req-3aa638ad-7844-4ff0-8421-7bf884793c15 tempest-TestShelveInstance-2055589282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:55:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-fd6e25d3-c315-4966-9084-ca102057ca04 req-3aa638ad-7844-4ff0-8421-7bf884793c15 tempest-TestShelveInstance-2055589282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:55:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-fd6e25d3-c315-4966-9084-ca102057ca04 req-3aa638ad-7844-4ff0-8421-7bf884793c15 tempest-TestShelveInstance-2055589282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-b8cbe83a-d944-4395-abfc-016b7112f04b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '791570dc-51ca-476e-94e3-7618a94cc9ac', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:55:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-fd6e25d3-c315-4966-9084-ca102057ca04 req-3aa638ad-7844-4ff0-8421-7bf884793c15 tempest-TestShelveInstance-2055589282 None] attachment_update completed successfully. Nov 02 17:56:03 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:56:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Flow 'volume_create_manager' (84d369c0-fd05-472f-9ccf-684145edde3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:56:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e30ff5c-34ee-4644-8211-d3ff41ce8ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e30ff5c-34ee-4644-8211-d3ff41ce8ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-890566260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f40b4d6-64b4-4369-b6db-d65220ecacd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e3feb8491046e4a7e2d0d85b6ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:56:04Z,use_quota=True,user_id='0248314279304d109d76e5fc0c75c27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37eefb0c-6126-4dd7-b088-82cabea1be6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37eefb0c-6126-4dd7-b088-82cabea1be6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5ec26a-473a-4cc9-9748-f4e790c9cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e5ec26a-473a-4cc9-9748-f4e790c9cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f40b4d6-64b4-4369-b6db-d65220ecacd9', 'volume_name': 'volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a8c8d9-22ae-4db0-a973-3e4048f4261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a8c8d9-22ae-4db0-a973-3e4048f4261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d719034-05a2-4853-8899-ca3d3f2f7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Volume 6f40b4d6-64b4-4369-b6db-d65220ecacd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9', 'volume_size': 1} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-890566260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f40b4d6-64b4-4369-b6db-d65220ecacd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e3feb8491046e4a7e2d0d85b6ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:56:04Z,use_quota=True,user_id='0248314279304d109d76e5fc0c75c27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Creating volume 6f40b4d6-64b4-4369-b6db-d65220ecacd9 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:56:04 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:04 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 1073741824 Nov 02 17:56:04 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:04 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 1073741824" returned: 0 in 0.819s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:04 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 Nov 02 17:56:04 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:05 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9" returned: 0 in 0.392s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d719034-05a2-4853-8899-ca3d3f2f7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e254a91-768c-4e6c-86d7-fa6707ea29cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Volume volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 (6f40b4d6-64b4-4369-b6db-d65220ecacd9): created successfully Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e254a91-768c-4e6c-86d7-fa6707ea29cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Flow 'volume_create_manager' (84d369c0-fd05-472f-9ccf-684145edde3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:56:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ad5bc98b-e729-41b6-b5f1-11ea5fe087d0 tempest-AttachVolumeNegativeTest-1140225009 None] Created volume successfully. Nov 02 17:56:07 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=64,cinder:UPDATE=54,cinder:INSERT=22,cinder:DELETE=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:56:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-0b81a756-3b2b-40b8-a4db-bd0b1ce79049 req-76021b19-701e-465e-b432-40d343d0235e tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-0b81a756-3b2b-40b8-a4db-bd0b1ce79049 req-76021b19-701e-465e-b432-40d343d0235e tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-0b81a756-3b2b-40b8-a4db-bd0b1ce79049 req-76021b19-701e-465e-b432-40d343d0235e tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-0b81a756-3b2b-40b8-a4db-bd0b1ce79049 req-76021b19-701e-465e-b432-40d343d0235e tempest-AttachVolumeNegativeTest-1140225009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35ca0f9f-fc3e-4ac4-ac03-bd97d4dcc299', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:56:07 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=60,cinder:UPDATE=58,cinder:DELETE=7,cinder:INSERT=20 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:56:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-0b81a756-3b2b-40b8-a4db-bd0b1ce79049 req-76021b19-701e-465e-b432-40d343d0235e tempest-AttachVolumeNegativeTest-1140225009 None] attachment_update completed successfully. Nov 02 17:56:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-f48401bb-2a2d-4c09-9295-8d0a1b385a8a req-e5bc6a47-4906-4376-a655-4cb6fd1fbaa5 tempest-AttachVolumeNegativeTest-1140225009 None] Terminate volume connection completed successfully. Nov 02 17:56:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-f48401bb-2a2d-4c09-9295-8d0a1b385a8a req-e5bc6a47-4906-4376-a655-4cb6fd1fbaa5 tempest-AttachVolumeNegativeTest-1140225009 None] Deleting attachment 35ca0f9f-fc3e-4ac4-ac03-bd97d4dcc299. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:56:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-c712eb4d-b9c7-48da-94f5-37d5c6d19ebf req-8e4feb7c-5d83-4f05-a297-119884949a8b tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-c712eb4d-b9c7-48da-94f5-37d5c6d19ebf req-8e4feb7c-5d83-4f05-a297-119884949a8b tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-c712eb4d-b9c7-48da-94f5-37d5c6d19ebf req-8e4feb7c-5d83-4f05-a297-119884949a8b tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-c712eb4d-b9c7-48da-94f5-37d5c6d19ebf req-8e4feb7c-5d83-4f05-a297-119884949a8b tempest-TestInstancesWithCinderVolumes-1954485388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5f804e5-4962-45ec-af6a-4f447b4e0a30', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:56:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-c712eb4d-b9c7-48da-94f5-37d5c6d19ebf req-8e4feb7c-5d83-4f05-a297-119884949a8b tempest-TestInstancesWithCinderVolumes-1954485388 None] attachment_update completed successfully. Nov 02 17:56:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-752d4a12-ff64-493c-9eb2-9371097c9e5c req-14b78cb6-6bc6-45a6-aeed-4ed3fc3ceb1d tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-752d4a12-ff64-493c-9eb2-9371097c9e5c req-14b78cb6-6bc6-45a6-aeed-4ed3fc3ceb1d tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-752d4a12-ff64-493c-9eb2-9371097c9e5c req-14b78cb6-6bc6-45a6-aeed-4ed3fc3ceb1d tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-752d4a12-ff64-493c-9eb2-9371097c9e5c req-14b78cb6-6bc6-45a6-aeed-4ed3fc3ceb1d tempest-TestInstancesWithCinderVolumes-1954485388 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-e1e9e93f-1e94-478a-a054-05a57d108f17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca662e6e-adc6-4484-b2b1-29191f1c19a3', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:56:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-752d4a12-ff64-493c-9eb2-9371097c9e5c req-14b78cb6-6bc6-45a6-aeed-4ed3fc3ceb1d tempest-TestInstancesWithCinderVolumes-1954485388 None] attachment_update completed successfully. Nov 02 17:56:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-a5c6b5e7-d7c6-4204-a3a5-b7b1a0cb051d req-0d55f673-7709-4df0-9be2-fc8c2068d4c4 tempest-TestInstancesWithCinderVolumes-1954485388 None] Terminate volume connection completed successfully. Nov 02 17:56:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-a5c6b5e7-d7c6-4204-a3a5-b7b1a0cb051d req-0d55f673-7709-4df0-9be2-fc8c2068d4c4 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deleting attachment d5f804e5-4962-45ec-af6a-4f447b4e0a30. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:56:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "cinder-e6d033b3-25c2-44e5-aaf4-13c0fe14d348-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-e6d033b3-25c2-44e5-aaf4-13c0fe14d348-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "cinder-quobyte-e6d033b3-25c2-44e5-aaf4-13c0fe14d348" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-quobyte-e6d033b3-25c2-44e5-aaf4-13c0fe14d348" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d8dbe5-0adc-453e-b6eb-20dbfb6189d0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:56:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:27 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 Nov 02 17:56:27 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:28 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348" returned: 0 in 0.669s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:28 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348 Nov 02 17:56:28 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:28 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e6d033b3-25c2-44e5-aaf4-13c0fe14d348" returned: 0 in 0.584s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-quobyte-e6d033b3-25c2-44e5-aaf4-13c0fe14d348" released by "delete_volume" :: held 1.372s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:28 devstack cinder-volume[86585]: WARNING cinder.quota [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-24576785-1090065889 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-24576785-1090065889, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:56:28 devstack cinder-volume[86585]: WARNING cinder.quota [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-24576785-1090065889 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-24576785-1090065889, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:56:28 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Created reservations ['e16fe3d2-3cda-44d2-be80-2ef9e804ecb7', 'cbeb1ad8-ba55-49a4-8b30-575fa49f1332', 'ca14c06d-bad5-4698-953e-f026a32e1d7e', '283861c2-7c04-47d2-adfa-3999d7b06e57'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:29 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:56:29 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:29 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.439s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:56:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deleted volume successfully. Nov 02 17:56:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f175f72d-7bd4-4a3f-9c7c-adbecb566f42 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-e6d033b3-25c2-44e5-aaf4-13c0fe14d348-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-d0c648a9-3bd8-494b-8055-920d932d1bd4 req-058335e6-1ac2-49a1-8554-d3511eb3b98b tempest-TestShelveInstance-2055589282 None] Terminate volume connection completed successfully. Nov 02 17:56:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-d0c648a9-3bd8-494b-8055-920d932d1bd4 req-058335e6-1ac2-49a1-8554-d3511eb3b98b tempest-TestShelveInstance-2055589282 None] Deleting attachment 791570dc-51ca-476e-94e3-7618a94cc9ac. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:56:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-a6987eca-e7ca-43a0-8892-239327265dd5 req-fcf9cb8c-dcef-41d1-9055-1e5ee07731e5 tempest-TestInstancesWithCinderVolumes-1954485388 None] Terminate volume connection completed successfully. Nov 02 17:56:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-a6987eca-e7ca-43a0-8892-239327265dd5 req-fcf9cb8c-dcef-41d1-9055-1e5ee07731e5 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deleting attachment ca662e6e-adc6-4484-b2b1-29191f1c19a3. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:56:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "cinder-e1e9e93f-1e94-478a-a054-05a57d108f17-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-e1e9e93f-1e94-478a-a054-05a57d108f17-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "cinder-quobyte-e1e9e93f-1e94-478a-a054-05a57d108f17" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-quobyte-e1e9e93f-1e94-478a-a054-05a57d108f17" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:35 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a70050a-48b9-4dc0-ba77-6e72ef51dc47]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:56:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:35 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 Nov 02 17:56:35 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:35 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17" returned: 0 in 0.541s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:35 devstack sudo[98646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17 Nov 02 17:56:35 devstack sudo[98646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:36 devstack sudo[98646]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e1e9e93f-1e94-478a-a054-05a57d108f17" returned: 0 in 0.444s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-quobyte-e1e9e93f-1e94-478a-a054-05a57d108f17" released by "delete_volume" :: held 1.082s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:36 devstack cinder-volume[86585]: WARNING cinder.quota [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881025705-958052787 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881025705-958052787, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:56:36 devstack cinder-volume[86585]: WARNING cinder.quota [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881025705-958052787 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-881025705-958052787, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Created reservations ['b69ee40a-8f27-4c69-b112-a877b2110a9e', '2a2bb990-9bcc-4a86-ae84-39261b642fee', 'e1ea8516-ce67-4022-97ae-6afcc9a4d2de', '14226f34-85cb-4ecd-912f-96c3aac7a258'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:36 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:56:36 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:37 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.501s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:37 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:56:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deleted volume successfully. Nov 02 17:56:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-19d4ec8c-7cfa-409b-b89e-36539203a010 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-e1e9e93f-1e94-478a-a054-05a57d108f17-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ada94f2b-9171-4691-a874-4bfcb648c980 req-f4ba6aac-fd6e-4419-9729-bcc8de13ce16 tempest-TestShelveInstance-2055589282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ada94f2b-9171-4691-a874-4bfcb648c980 req-f4ba6aac-fd6e-4419-9729-bcc8de13ce16 tempest-TestShelveInstance-2055589282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ada94f2b-9171-4691-a874-4bfcb648c980 req-f4ba6aac-fd6e-4419-9729-bcc8de13ce16 tempest-TestShelveInstance-2055589282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-ada94f2b-9171-4691-a874-4bfcb648c980 req-f4ba6aac-fd6e-4419-9729-bcc8de13ce16 tempest-TestShelveInstance-2055589282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-b8cbe83a-d944-4395-abfc-016b7112f04b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc431ca5-5f93-4c7f-a4ec-177796d0c677', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:56:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-ada94f2b-9171-4691-a874-4bfcb648c980 req-f4ba6aac-fd6e-4419-9729-bcc8de13ce16 tempest-TestShelveInstance-2055589282 None] attachment_update completed successfully. Nov 02 17:56:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-b4d65834-f857-4a78-aa0c-fec45182c796 req-247105b7-6443-47c4-a993-0abcc9cfaaa0 tempest-TestInstancesWithCinderVolumes-1954485388 None] Terminate volume connection completed successfully. Nov 02 17:56:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-b4d65834-f857-4a78-aa0c-fec45182c796 req-247105b7-6443-47c4-a993-0abcc9cfaaa0 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deleting attachment a75dc2bf-9139-40ea-ade9-528c73998aba. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:56:41 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Flow 'volume_create_manager' (33b5ecb0-5414-47b0-bee1-8ed60c063b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fb6c37-32ef-4b41-9d3a-eec59a3db652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0fb6c37-32ef-4b41-9d3a-eec59a3db652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1477836216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e04efa0ef644e7292b5230a9922f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:56:42Z,use_quota=True,user_id='158ceb2be3604fc9a61a7b990fbf07c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8484ad6-a6fe-4c91-baae-ce9d46fd2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8484ad6-a6fe-4c91-baae-ce9d46fd2c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49280212-df22-4284-bdf2-013dfd5a4fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49280212-df22-4284-bdf2-013dfd5a4fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d', 'volume_name': 'volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a614d3d-4789-4d59-a163-104ffc403be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a614d3d-4789-4d59-a163-104ffc403be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92611ac6-b2c7-48cd-9a88-6b6d55341d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:42 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Volume ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d', 'volume_size': 1} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1477836216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e04efa0ef644e7292b5230a9922f7d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:56:42Z,use_quota=True,user_id='158ceb2be3604fc9a61a7b990fbf07c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Creating volume ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:56:42 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:42 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d 1073741824 Nov 02 17:56:42 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "cinder-d7680e29-2640-422d-b7ec-740ee59dbfa9-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-d7680e29-2640-422d-b7ec-740ee59dbfa9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "cinder-quobyte-d7680e29-2640-422d-b7ec-740ee59dbfa9" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-quobyte-d7680e29-2640-422d-b7ec-740ee59dbfa9" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961f368-2e58-4dc7-a4db-9cef38126631]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:42 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 Nov 02 17:56:42 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:42 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d 1073741824" returned: 0 in 0.551s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:42 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d Nov 02 17:56:42 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:42 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9" returned: 0 in 0.408s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:42 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9 Nov 02 17:56:42 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:42 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d" returned: 0 in 0.290s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92611ac6-b2c7-48cd-9a88-6b6d55341d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70a4794-96d3-4eb6-8cb4-f2688805c7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:42 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Volume volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d (ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d): created successfully Nov 02 17:56:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70a4794-96d3-4eb6-8cb4-f2688805c7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Flow 'volume_create_manager' (33b5ecb0-5414-47b0-bee1-8ed60c063b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:56:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-938824e8-c142-408c-b0f2-f543fa6baf68 tempest-VolumesServicesTestJSON-873248413 None] Created volume successfully. Nov 02 17:56:43 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d7680e29-2640-422d-b7ec-740ee59dbfa9" returned: 0 in 0.255s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-quobyte-d7680e29-2640-422d-b7ec-740ee59dbfa9" released by "delete_volume" :: held 0.712s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:43 devstack cinder-volume[86585]: WARNING cinder.quota [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1242268665-635961481 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1242268665-635961481, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:56:43 devstack cinder-volume[86585]: WARNING cinder.quota [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1242268665-635961481 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1242268665-635961481, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Created reservations ['c1d7cccd-7718-4ab7-9752-fd49d9000f17', 'f133d637-4e86-4af3-970b-10189c0b868f', 'b76c338e-9680-4536-b275-6292a37622a1', 'f42e4942-6265-4356-bbd0-b98e147ed420'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:43 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:56:43 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:43 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:56:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Deleted volume successfully. Nov 02 17:56:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6e124174-e759-4f29-abf9-ffcea7d8ef43 tempest-TestInstancesWithCinderVolumes-1954485388 None] Lock "cinder-d7680e29-2640-422d-b7ec-740ee59dbfa9-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Acquiring lock "cinder-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Lock "cinder-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Acquiring lock "cinder-quobyte-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:56:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Lock "cinder-quobyte-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:56:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[38da3095-cb2d-4b4b-b920-5a349a5404ee]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:56:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:44 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d Nov 02 17:56:44 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:45 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d" returned: 0 in 0.494s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:45 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d Nov 02 17:56:45 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:45 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Lock "cinder-quobyte-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d" released by "delete_volume" :: held 0.930s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Created reservations ['3132ddb1-cf0b-4647-85a0-4c1f35d67911', '2761ee28-f1a3-41c6-bfe5-ce68f70d0eea', '2c1945d1-0a57-4961-b044-dab85394e1a4', '05373e80-6b0f-46cc-9815-cdffe3a36666'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:45 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:56:45 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:46 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.303s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:56:46 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Deleted volume successfully. Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd43628f-5816-4dda-952c-955e4fe76bdc tempest-VolumesServicesTestJSON-873248413 None] Lock "cinder-ad7c3fb7-8944-4b0a-a1c0-ab4769f5dc2d-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:46 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:56:46 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:46 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.374s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:56:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Flow 'volume_create_manager' (b7800d7d-eca7-460d-bc2b-fe84463dbd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7dbf99-028d-4f55-a4e9-dd8da3bdd5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7dbf99-028d-4f55-a4e9-dd8da3bdd5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1386842307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e1bc05-9d01-48c5-979c-1fdd0d41f56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e3feb8491046e4a7e2d0d85b6ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:56:53Z,use_quota=True,user_id='0248314279304d109d76e5fc0c75c27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab7d853-f83d-47a3-a7f3-e6276ba00d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab7d853-f83d-47a3-a7f3-e6276ba00d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c656fc-186f-440d-85af-09f5e8a72a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c656fc-186f-440d-85af-09f5e8a72a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e1bc05-9d01-48c5-979c-1fdd0d41f56f', 'volume_name': 'volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09162b9d-c747-4488-85c9-7839c35659aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09162b9d-c747-4488-85c9-7839c35659aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a05eff-a446-442a-90ad-d8b1568f0802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:53 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Volume b3e1bc05-9d01-48c5-979c-1fdd0d41f56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f', 'volume_size': 1} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1386842307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e1bc05-9d01-48c5-979c-1fdd0d41f56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e3feb8491046e4a7e2d0d85b6ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:56:53Z,use_quota=True,user_id='0248314279304d109d76e5fc0c75c27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Creating volume b3e1bc05-9d01-48c5-979c-1fdd0d41f56f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:56:53 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:56:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:53 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f 1073741824 Nov 02 17:56:53 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:53 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f 1073741824" returned: 0 in 0.533s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:56:54 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f Nov 02 17:56:54 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:56:54 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f" returned: 0 in 0.380s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a05eff-a446-442a-90ad-d8b1568f0802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76443538-df51-45b6-8166-54bbfa23f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:56:54 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Volume volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f (b3e1bc05-9d01-48c5-979c-1fdd0d41f56f): created successfully Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76443538-df51-45b6-8166-54bbfa23f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:56:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Flow 'volume_create_manager' (b7800d7d-eca7-460d-bc2b-fe84463dbd45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:56:54 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-95727a4d-bf5e-4e42-afbc-20786315005f tempest-AttachVolumeNegativeTest-1140225009 None] Created volume successfully. Nov 02 17:56:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-e8fcc20d-29b8-4f4b-8fb1-bb9fe866f825 req-55af8bbb-fd90-4e9e-af47-7e4265228963 tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:56:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-e8fcc20d-29b8-4f4b-8fb1-bb9fe866f825 req-55af8bbb-fd90-4e9e-af47-7e4265228963 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:56:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-e8fcc20d-29b8-4f4b-8fb1-bb9fe866f825 req-55af8bbb-fd90-4e9e-af47-7e4265228963 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:56:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-e8fcc20d-29b8-4f4b-8fb1-bb9fe866f825 req-55af8bbb-fd90-4e9e-af47-7e4265228963 tempest-AttachVolumeNegativeTest-1140225009 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46ac81a1-f7c0-4575-86b6-f8e537364a85', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:56:56 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-e8fcc20d-29b8-4f4b-8fb1-bb9fe866f825 req-55af8bbb-fd90-4e9e-af47-7e4265228963 tempest-AttachVolumeNegativeTest-1140225009 None] attachment_update completed successfully. Nov 02 17:56:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-2df16628-c558-4835-afdc-b3503aea5d7d req-3207d03c-ee09-433e-a075-d5a646683d4d tempest-AttachVolumeNegativeTest-1140225009 None] Terminate volume connection completed successfully. Nov 02 17:56:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-2df16628-c558-4835-afdc-b3503aea5d7d req-3207d03c-ee09-433e-a075-d5a646683d4d tempest-AttachVolumeNegativeTest-1140225009 None] Deleting attachment 46ac81a1-f7c0-4575-86b6-f8e537364a85. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "cinder-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "cinder-quobyte-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-quobyte-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6681d087-8ef2-4a94-abb1-92431f81742f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:05 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f Nov 02 17:57:05 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:05 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f" returned: 0 in 0.436s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:06 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f Nov 02 17:57:06 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:06 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-quobyte-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f" released by "delete_volume" :: held 0.791s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Created reservations ['1701f686-67b9-43c0-930e-de170c1f8480', '338106db-0303-40bf-8767-ead2fc1ccda1', '8cf8e114-1778-47c3-8f80-94fd549e947e', 'dd91d030-d63e-4d0c-82a7-8d5c414ec75b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:06 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:57:06 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:06 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.294s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:57:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Deleted volume successfully. Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "cinder-6f40b4d6-64b4-4369-b6db-d65220ecacd9-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a0f9e0ab-735c-4ea0-a20b-7660a386c317 tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-b3e1bc05-9d01-48c5-979c-1fdd0d41f56f-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-6f40b4d6-64b4-4369-b6db-d65220ecacd9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "cinder-quobyte-6f40b4d6-64b4-4369-b6db-d65220ecacd9" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-quobyte-6f40b4d6-64b4-4369-b6db-d65220ecacd9" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7543d873-2153-47a8-9460-1a92a3b49cd7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:07 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 Nov 02 17:57:07 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:07 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9" returned: 0 in 0.394s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:07 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9 Nov 02 17:57:07 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:07 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6f40b4d6-64b4-4369-b6db-d65220ecacd9" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-quobyte-6f40b4d6-64b4-4369-b6db-d65220ecacd9" released by "delete_volume" :: held 0.769s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=68,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=65,cinder:UPDATE=56,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Created reservations ['09da7672-2b64-468e-ae0d-cae2cece549e', '43515fdb-f838-4d21-aa8e-d3179fa3920e', '3b60bfe2-5de2-4fae-967f-1ef7be5a4e92', '244a551d-602a-41d6-a996-318658fa0f1a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:08 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:57:08 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:08 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.340s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "cinder-692c1b3b-fba1-4209-b11a-53eb57947247-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Deleted volume successfully. Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-692c1b3b-fba1-4209-b11a-53eb57947247-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-42ad64b1-4902-4981-b7a4-b53949d1162d tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-6f40b4d6-64b4-4369-b6db-d65220ecacd9-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "cinder-quobyte-692c1b3b-fba1-4209-b11a-53eb57947247" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-quobyte-692c1b3b-fba1-4209-b11a-53eb57947247" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a58384-73a1-4109-a655-ec58344ada3c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:08 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 Nov 02 17:57:08 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:09 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247" returned: 0 in 0.622s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:09 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247 Nov 02 17:57:09 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:09 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-692c1b3b-fba1-4209-b11a-53eb57947247" returned: 0 in 0.348s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-quobyte-692c1b3b-fba1-4209-b11a-53eb57947247" released by "delete_volume" :: held 1.053s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Created reservations ['eb3e6f4b-e3f2-4d25-96f0-0b6fe38ec882', 'b4c1d4a7-c585-489c-863b-5a2c09363448', 'ea67e505-87a3-4675-830d-39e11a042952', '8781ea43-4845-4c50-9fe5-5ef7136b8a1f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:09 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:57:09 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:10 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:10 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:57:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Deleted volume successfully. Nov 02 17:57:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddb5cb9f-2a00-41de-9de7-5dadfde2b3bc tempest-AttachVolumeNegativeTest-1140225009 None] Lock "cinder-692c1b3b-fba1-4209-b11a-53eb57947247-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:19 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:INSERT=3,cinder:UPDATE=20,cinder:SELECT=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:57:20 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Flow 'volume_create_manager' (be6772c9-05a9-4767-abc8-adec029609ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34fe6f3-fb41-48da-aef9-2ec5ce243b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34fe6f3-fb41-48da-aef9-2ec5ce243b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1630460901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29013fc5-6ca2-4069-b296-d06fe26c74fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b81393b61c444939f45bc89e06f76e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:27Z,use_quota=True,user_id='481e91b01f8d40d282d593b65e1ee4a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79050255-1891-4e22-9345-87a6531f499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79050255-1891-4e22-9345-87a6531f499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4ab832-8ccf-4334-b8b9-7cb7a404f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4ab832-8ccf-4334-b8b9-7cb7a404f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29013fc5-6ca2-4069-b296-d06fe26c74fa', 'volume_name': 'volume-29013fc5-6ca2-4069-b296-d06fe26c74fa', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e3d77c-011c-433d-ab03-594857d6e5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e3d77c-011c-433d-ab03-594857d6e5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bcdf95-ef78-4b72-a265-d7de26637218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Volume 29013fc5-6ca2-4069-b296-d06fe26c74fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29013fc5-6ca2-4069-b296-d06fe26c74fa', 'volume_size': 1} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1630460901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29013fc5-6ca2-4069-b296-d06fe26c74fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b81393b61c444939f45bc89e06f76e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:27Z,use_quota=True,user_id='481e91b01f8d40d282d593b65e1ee4a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Creating volume 29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:57:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:57:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:27 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa 1073741824 Nov 02 17:57:27 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:28 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa 1073741824" returned: 0 in 0.517s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:28 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa Nov 02 17:57:28 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:28 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bcdf95-ef78-4b72-a265-d7de26637218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29013fc5-6ca2-4069-b296-d06fe26c74fa', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7df7d9a-ce7a-496a-808c-acff6627ea6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Volume volume-29013fc5-6ca2-4069-b296-d06fe26c74fa (29013fc5-6ca2-4069-b296-d06fe26c74fa): created successfully Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7df7d9a-ce7a-496a-808c-acff6627ea6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Flow 'volume_create_manager' (be6772c9-05a9-4767-abc8-adec029609ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-5cb271f8-6808-467f-b77d-7957cdb5e742 req-4fb9e563-ad83-4aa2-b689-ddbe6a4c2f63 tempest-VolumesSnapshotsTestJSON-1298152712 None] Created volume successfully. Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Creating offline snapshot 31e4f994-d8be-4e54-9f4b-6699ada92b34 of volume 29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef999e-25b0-462e-af41-e48caffe103b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:29 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa Nov 02 17:57:29 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:29 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa" returned: 0 in 0.481s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:29 devstack sudo[99455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 1G Nov 02 17:57:29 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-9809adec-7106-4bb1-bd3d-fc4c21c1f52e tempest-TestShelveInstance-2055589282 None] Terminate volume connection completed successfully. Nov 02 17:57:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-9809adec-7106-4bb1-bd3d-fc4c21c1f52e tempest-TestShelveInstance-2055589282 None] Deleting attachment cc431ca5-5f93-4c7f-a4ec-177796d0c677. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:57:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Acquiring lock "cinder-b8cbe83a-d944-4395-abfc-016b7112f04b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Lock "cinder-b8cbe83a-d944-4395-abfc-016b7112f04b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:30 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Acquiring lock "cinder-quobyte-b8cbe83a-d944-4395-abfc-016b7112f04b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 1G" returned: 0 in 0.641s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29013fc5-6ca2-4069-b296-d06fe26c74fa -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:30 devstack sudo[99462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29013fc5-6ca2-4069-b296-d06fe26c74fa -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 Nov 02 17:57:30 devstack sudo[99462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Lock "cinder-quobyte-b8cbe83a-d944-4395-abfc-016b7112f04b" acquired by "delete_volume" :: waited 0.075s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b6cb7-bcef-4a99-aac6-d6efe6c2ea93]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:30 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b Nov 02 17:57:30 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:30 devstack sudo[99462]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29013fc5-6ca2-4069-b296-d06fe26c74fa -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34" returned: 0 in 0.590s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:30 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 is being set with open permissions: ugo+rw Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:30 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 Nov 02 17:57:30 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:30 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b" returned: 0 in 0.663s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:30 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b Nov 02 17:57:30 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:31 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:31 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info Nov 02 17:57:31 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:31 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b8cbe83a-d944-4395-abfc-016b7112f04b" returned: 0 in 0.387s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Lock "cinder-quobyte-b8cbe83a-d944-4395-abfc-016b7112f04b" released by "delete_volume" :: held 1.172s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG cinder.quota [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Created reservations ['22ac06b3-8b52-4312-9aaa-32f7489e6541', '47a74c56-c1c8-441e-9efb-e3e9b124e04e', '93b6f69e-33de-41b2-b78c-2c9d8253b50f', 'd4cbb599-9cb2-4a18-8112-7ad87edaabf4'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:57:31 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:31 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info is being set with open permissions: ugo+rw Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:31 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info Nov 02 17:57:31 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:31 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:57:31 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:31 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.info" returned: 0 in 0.347s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-04fab08f-1380-4254-a592-74901e995661 req-ce4e236f-4ece-42ec-9e5b-9211e76d7ffd tempest-VolumesSnapshotsTestJSON-1298152712 None] Create snapshot completed successfully Nov 02 17:57:31 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.356s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG cinder.manager [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:57:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Deleted volume successfully. Nov 02 17:57:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-efc20ad2-d75d-470c-b038-0f2555a55784 req-53846e6e-8047-43d8-96b9-026bc1695956 tempest-TestShelveInstance-2055589282 None] Lock "cinder-b8cbe83a-d944-4395-abfc-016b7112f04b-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "cinder-31e4f994-d8be-4e54-9f4b-6699ada92b34-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-31e4f994-d8be-4e54-9f4b-6699ada92b34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "cinder-quobyte-29013fc5-6ca2-4069-b296-d06fe26c74fa" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-quobyte-29013fc5-6ca2-4069-b296-d06fe26c74fa" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "cinder-quobyte-31e4f994-d8be-4e54-9f4b-6699ada92b34" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-quobyte-31e4f994-d8be-4e54-9f4b-6699ada92b34" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Deleting offline snapshot 31e4f994-d8be-4e54-9f4b-6699ada92b34 of volume 29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] snapshot_file for this snap is: volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb57af0b-6a4b-4e41-868a-9276fc3a45be]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:32 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 Nov 02 17:57:32 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:33 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34" returned: 0 in 0.448s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29013fc5-6ca2-4069-b296-d06fe26c74fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:57:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afa7c76-3afd-4d36-8688-6c904406ef05]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:33 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa Nov 02 17:57:33 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:33 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa" returned: 0 in 0.419s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:33 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 Nov 02 17:57:33 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:34 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34" returned: 0 in 0.420s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:34 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34 Nov 02 17:57:34 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:34 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa.31e4f994-d8be-4e54-9f4b-6699ada92b34" returned: 0 in 0.273s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-quobyte-31e4f994-d8be-4e54-9f4b-6699ada92b34" released by "_delete_snapshot" :: held 1.767s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-quobyte-29013fc5-6ca2-4069-b296-d06fe26c74fa" released by "delete_snapshot" :: held 1.804s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.quota [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Created reservations ['8c23398b-bbad-404a-9d48-97533dca916c', '446ed833-8ff7-4cc7-9c15-bb710cdfa35e', '4762a0bf-35f3-4227-8af1-f4f5b3ed4d86', '2e6e6ceb-0898-4e9c-bd48-42d45efc8c5c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:57:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Delete snapshot completed successfully. Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-1eecd51d-aae6-4cc1-8ac0-c87674cc6e15 req-3f447135-a6c1-4c24-a0ee-67e83f2a0e0a tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-31e4f994-d8be-4e54-9f4b-6699ada92b34-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "cinder-29013fc5-6ca2-4069-b296-d06fe26c74fa-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-29013fc5-6ca2-4069-b296-d06fe26c74fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "cinder-quobyte-29013fc5-6ca2-4069-b296-d06fe26c74fa" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-quobyte-29013fc5-6ca2-4069-b296-d06fe26c74fa" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:35 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30bfe3-19fd-41a8-85ab-625162a3315b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:35 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa Nov 02 17:57:35 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:35 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa" returned: 0 in 0.578s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:35 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa Nov 02 17:57:35 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:36 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-29013fc5-6ca2-4069-b296-d06fe26c74fa" returned: 0 in 0.409s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-quobyte-29013fc5-6ca2-4069-b296-d06fe26c74fa" released by "delete_volume" :: held 1.089s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG cinder.quota [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Created reservations ['489b2ec4-b9ef-4072-a7e0-5284c109c69e', 'db81e823-1f4e-4320-ab40-13cc2649104b', 'c2132ac0-b213-46f9-8ac2-93689d72c124', 'a1fdea1a-28d0-4349-b84f-bf600e36766c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:36 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:57:36 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:36 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG cinder.manager [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:57:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Deleted volume successfully. Nov 02 17:57:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [req-f7f9fc2b-5579-41dc-bc22-a6b8984f4ea9 req-9ba45210-1a6f-4f7f-81eb-5b2d702a1c6e tempest-VolumesSnapshotsTestJSON-1298152712 None] Lock "cinder-29013fc5-6ca2-4069-b296-d06fe26c74fa-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:57:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-883d57c3-6ac5-457f-8b6c-3ab50e1ff964 tempest-GroupSnapshotsTest-1073459792 None] Group tempest-GroupSnapshotsTest-Group-76721612: creating Nov 02 17:57:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-883d57c3-6ac5-457f-8b6c-3ab50e1ff964 tempest-GroupSnapshotsTest-1073459792 None] Group tempest-GroupSnapshotsTest-Group-76721612: created successfully Nov 02 17:57:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-883d57c3-6ac5-457f-8b6c-3ab50e1ff964 tempest-GroupSnapshotsTest-1073459792 None] Create group completed successfully. Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (60a12799-6bf5-4b9d-a48f-70efdfe08bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec46d7dd-ea0b-428c-980a-9c66ce5fbf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec46d7dd-ea0b-428c-980a-9c66ce5fbf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1764686022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67a745c2-707e-444e-b0df-1836d1294b2a,host='devstack@QuobyteHD#QuobyteHD',id=1b3f4c1c-c59a-4962-9bce-df49efe82678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:46Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e512e3b9-cb2c-4327-8f76-5bbee9b07e28),volume_type_id=e512e3b9-cb2c-4327-8f76-5bbee9b07e28)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0394a749-4c92-43f5-b369-f8bfaf4e3e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0394a749-4c92-43f5-b369-f8bfaf4e3e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06c4f17-b78c-4d04-b669-05cc75237f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06c4f17-b78c-4d04-b669-05cc75237f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b3f4c1c-c59a-4962-9bce-df49efe82678', 'volume_name': 'volume-1b3f4c1c-c59a-4962-9bce-df49efe82678', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ade539-7348-4260-aa3b-5c687b4ea87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ade539-7348-4260-aa3b-5c687b4ea87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe27cc39-a62a-4e3b-b786-b13c623f8567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:46 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Volume 1b3f4c1c-c59a-4962-9bce-df49efe82678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b3f4c1c-c59a-4962-9bce-df49efe82678', 'volume_size': 1} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67a745c2-707e-444e-b0df-1836d1294b2a,created_at=2026-11-02T16:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1764686022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67a745c2-707e-444e-b0df-1836d1294b2a,host='devstack@QuobyteHD#QuobyteHD',id=1b3f4c1c-c59a-4962-9bce-df49efe82678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:46Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e512e3b9-cb2c-4327-8f76-5bbee9b07e28),volume_type_id=e512e3b9-cb2c-4327-8f76-5bbee9b07e28)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Creating volume 1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:57:46 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:46 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 1073741824 Nov 02 17:57:46 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:46 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:57:46 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:47 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 1073741824" returned: 0 in 0.738s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:47 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.495s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:47 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 Nov 02 17:57:47 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:47 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678" returned: 0 in 0.297s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe27cc39-a62a-4e3b-b786-b13c623f8567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b3f4c1c-c59a-4962-9bce-df49efe82678', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6134f3-e265-4300-abfe-0d981f7b23d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:47 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Volume volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 (1b3f4c1c-c59a-4962-9bce-df49efe82678): created successfully Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c6134f3-e265-4300-abfe-0d981f7b23d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (60a12799-6bf5-4b9d-a48f-70efdfe08bd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8441a606-df29-407b-a0a1-48625d9ad555 tempest-GroupSnapshotsTest-1073459792 None] Created volume successfully. Nov 02 17:57:48 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] GroupSnapshot 0449ea46-aed1-43ae-870c-fa0b4164d5aa: creating. Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Group snapshot 0449ea46-aed1-43ae-870c-fa0b4164d5aa: creating. {{(pid=86585) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Creating offline snapshot 4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 of volume 1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f540ec1-f02e-4b54-9488-97e5f6a1b52f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:49 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 Nov 02 17:57:49 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:49 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678" returned: 0 in 0.680s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:49 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 1G Nov 02 17:57:49 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:50 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 1G" returned: 0 in 1.125s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:51 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 Nov 02 17:57:51 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:51 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" returned: 0 in 0.727s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:51 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:57:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:51 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 Nov 02 17:57:51 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:52 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" returned: 0 in 0.637s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:52 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info Nov 02 17:57:52 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:52 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info" returned: 0 in 0.550s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:52 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:57:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:52 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info Nov 02 17:57:52 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:53 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.info" returned: 0 in 0.511s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.378s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e72458fc-1a2e-4150-abe9-5dcd0fcc47b4 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 0449ea46-aed1-43ae-870c-fa0b4164d5aa: created successfully Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (19de1c6b-858b-48ea-9d4a-42bec68f8e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69c9e69-1e36-4db5-b35e-4ab6f0998515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69c9e69-1e36-4db5-b35e-4ab6f0998515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050926077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9806fc49-360c-424e-8677-81d850685cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:54Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c36461-3c51-494b-b12e-a33bc8b42aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c36461-3c51-494b-b12e-a33bc8b42aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc04843-0b19-40ec-9b9c-4f50c2ba7f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcc04843-0b19-40ec-9b9c-4f50c2ba7f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9806fc49-360c-424e-8677-81d850685cba', 'volume_name': 'volume-9806fc49-360c-424e-8677-81d850685cba', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9369a46-c093-4fac-b70c-ba983dc2db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9369a46-c093-4fac-b70c-ba983dc2db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bb52e0-4bc8-4f0f-bbea-1b336cc8ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:54 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Volume 9806fc49-360c-424e-8677-81d850685cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9806fc49-360c-424e-8677-81d850685cba', 'volume_size': 1} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2050926077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9806fc49-360c-424e-8677-81d850685cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:54Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Creating volume 9806fc49-360c-424e-8677-81d850685cba {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:57:54 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:57:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:54 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba 1073741824 Nov 02 17:57:54 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:55 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba 1073741824" returned: 0 in 1.023s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:56 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba Nov 02 17:57:56 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:56 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba" returned: 0 in 0.593s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.562s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-4b18aa0d-aa32-4068-aff3-c8e7aa6ea240-3aed15c1-8702-4be2-801b-41b12bdf8a31" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bb52e0-4bc8-4f0f-bbea-1b336cc8ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9806fc49-360c-424e-8677-81d850685cba', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fae358d-15cf-480c-9df2-49779dcaa6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-4b18aa0d-aa32-4068-aff3-c8e7aa6ea240-3aed15c1-8702-4be2-801b-41b12bdf8a31" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Creating volume 3aed15c1-8702-4be2-801b-41b12bdf8a31 from snapshot 4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-3aed15c1-8702-4be2-801b-41b12bdf8a31" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:56 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Volume volume-9806fc49-360c-424e-8677-81d850685cba (9806fc49-360c-424e-8677-81d850685cba): created successfully Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fae358d-15cf-480c-9df2-49779dcaa6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (19de1c6b-858b-48ea-9d4a-42bec68f8e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-3aed15c1-8702-4be2-801b-41b12bdf8a31" acquired by "_copy_volume_from_snapshot" :: waited 0.065s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] snapshot: 4b18aa0d-aa32-4068-aff3-c8e7aa6ea240, volume: 3aed15c1-8702-4be2-801b-41b12bdf8a31, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:57:56 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b0849476-ecef-4926-8002-93606d9281db tempest-VolumesActionsTest-906096550 None] Created volume successfully. Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4581d8a-8cfa-4cdd-9d0b-e1bf49b67c55]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:57 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 Nov 02 17:57:57 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:57 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" returned: 0 in 0.485s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3f4c1c-c59a-4962-9bce-df49efe82678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f391c-67d5-4741-a228-d45213758116]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:57 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 Nov 02 17:57:57 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Flow 'volume_create_manager' (cc56e2b9-50a5-4f56-9b22-d804fb770ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b82b9bc-e471-4399-8e10-4541797af2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b82b9bc-e471-4399-8e10-4541797af2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1268304629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6fddfa-bee1-4561-a1eb-d6ec2a91ee33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d2429c99d249bf8a183638cdcd6871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:58Z,use_quota=True,user_id='03c6b5141402402697587b2327ac8648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c9ec19-b4fc-444f-b0ab-69019960057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c9ec19-b4fc-444f-b0ab-69019960057d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8b9c59-8c50-4f7a-9479-af04f8df49b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8b9c59-8c50-4f7a-9479-af04f8df49b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6fddfa-bee1-4561-a1eb-d6ec2a91ee33', 'volume_name': 'volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4b3df6-839a-4e36-98cb-a8ff6a632eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4b3df6-839a-4e36-98cb-a8ff6a632eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:57:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef58bb04-e27c-420f-972d-c7ff1ced2db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:57:58 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Volume db6fddfa-bee1-4561-a1eb-d6ec2a91ee33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33', 'volume_size': 1} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f98ece8e-174e-43aa-aa2f-141b5fa054ca tempest-VolumesActionsTest-906096550 None] Acquiring lock "cinder-9806fc49-360c-424e-8677-81d850685cba" by "attach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f98ece8e-174e-43aa-aa2f-141b5fa054ca tempest-VolumesActionsTest-906096550 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba" acquired by "attach_volume" :: waited 0.055s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:57:58 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678" returned: 0 in 0.764s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:57:58 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 Nov 02 17:57:58 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:57:58 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f98ece8e-174e-43aa-aa2f-141b5fa054ca tempest-VolumesActionsTest-906096550 None] Attaching volume 9806fc49-360c-424e-8677-81d850685cba to instance f099a037-0b84-4f0f-9d27-3f26efcad942 at mountpoint /dev/vdb on host None. Nov 02 17:57:58 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f98ece8e-174e-43aa-aa2f-141b5fa054ca tempest-VolumesActionsTest-906096550 None] Attach volume completed successfully. Nov 02 17:57:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f98ece8e-174e-43aa-aa2f-141b5fa054ca tempest-VolumesActionsTest-906096550 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba" released by "attach_volume" :: held 0.234s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-108428a5-6760-4b3b-b83c-a6d6567d8def tempest-VolumesActionsTest-416294580 None] Terminate volume connection completed successfully. Nov 02 17:58:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-108428a5-6760-4b3b-b83c-a6d6567d8def tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-9806fc49-360c-424e-8677-81d850685cba-detach_volume" by "detach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-108428a5-6760-4b3b-b83c-a6d6567d8def tempest-VolumesActionsTest-416294580 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba-detach_volume" acquired by "detach_volume" :: waited 0.106s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-108428a5-6760-4b3b-b83c-a6d6567d8def tempest-VolumesActionsTest-416294580 None] Detaching volume 9806fc49-360c-424e-8677-81d850685cba from instance f099a037-0b84-4f0f-9d27-3f26efcad942. Nov 02 17:58:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-108428a5-6760-4b3b-b83c-a6d6567d8def tempest-VolumesActionsTest-416294580 None] Detach volume completed successfully. Nov 02 17:58:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-108428a5-6760-4b3b-b83c-a6d6567d8def tempest-VolumesActionsTest-416294580 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba-detach_volume" released by "detach_volume" :: held 0.222s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71d1a452-d9ac-4ddf-875d-7e589f4e1bef tempest-VolumesActionsTest-906096550 None] Acquiring lock "cinder-9806fc49-360c-424e-8677-81d850685cba-detach_volume" by "detach_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71d1a452-d9ac-4ddf-875d-7e589f4e1bef tempest-VolumesActionsTest-906096550 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba-detach_volume" acquired by "detach_volume" :: waited 0.107s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-71d1a452-d9ac-4ddf-875d-7e589f4e1bef tempest-VolumesActionsTest-906096550 None] Volume detach called, but volume not attached. Nov 02 17:58:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71d1a452-d9ac-4ddf-875d-7e589f4e1bef tempest-VolumesActionsTest-906096550 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Acquiring lock "cinder-9806fc49-360c-424e-8677-81d850685cba-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Acquiring lock "cinder-quobyte-9806fc49-360c-424e-8677-81d850685cba" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Lock "cinder-quobyte-9806fc49-360c-424e-8677-81d850685cba" acquired by "delete_volume" :: waited 0.052s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26838cc-004a-4d06-a409-e4e38a522859]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:04 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba Nov 02 17:58:04 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:05 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba" returned: 0 in 1.670s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:05 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba Nov 02 17:58:05 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:06 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-9806fc49-360c-424e-8677-81d850685cba" returned: 0 in 0.910s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Lock "cinder-quobyte-9806fc49-360c-424e-8677-81d850685cba" released by "delete_volume" :: held 2.762s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Created reservations ['ffe00695-5256-441c-8290-bca0794d5785', '7559062a-b5aa-4b82-9322-bf3f4b1af4e4', 'c0775399-9f1f-4517-8442-ec0ef11a4a5e', '9785d92e-c16b-4a7f-905c-2f5c71e49844'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:07 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:07 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:07 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.955s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:07 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Deleted volume successfully. Nov 02 17:58:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c0adab3d-d98e-4bbf-94e4-b87e588e6f1f tempest-VolumesActionsTest-906096550 None] Lock "cinder-9806fc49-360c-424e-8677-81d850685cba-delete_volume" released by "delete_volume" :: held 4.396s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:11 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31" returned: 0 in 12.969s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678, size 1024.00 MB, duration 12.97 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:58:11 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Converted 1024.00 MB image at 78.93 MB/s Nov 02 17:58:11 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:11 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 Nov 02 17:58:11 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:11 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-3aed15c1-8702-4be2-801b-41b12bdf8a31" released by "_copy_volume_from_snapshot" :: held 14.756s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-4b18aa0d-aa32-4068-aff3-c8e7aa6ea240-3aed15c1-8702-4be2-801b-41b12bdf8a31" released by "_create_volume_from_snapshot" :: held 14.887s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.955s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.549s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1268304629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6fddfa-bee1-4561-a1eb-d6ec2a91ee33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51d2429c99d249bf8a183638cdcd6871',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:57:58Z,use_quota=True,user_id='03c6b5141402402697587b2327ac8648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Creating volume db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:11 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:11 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 1073741824 Nov 02 17:58:11 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:11 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c10b6da1-9766-4f85-a3b1-7c00292799f7 tempest-GroupSnapshotsTest-1073459792 None] Create group from source-snapshot-0449ea46-aed1-43ae-870c-fa0b4164d5aa completed successfully. Nov 02 17:58:12 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 1073741824" returned: 0 in 0.513s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:12 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 Nov 02 17:58:12 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:12 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33" returned: 0 in 0.273s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef58bb04-e27c-420f-972d-c7ff1ced2db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d1884a-da3c-44fc-be0e-70744d97f233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:12 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Volume volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 (db6fddfa-bee1-4561-a1eb-d6ec2a91ee33): created successfully Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d1884a-da3c-44fc-be0e-70744d97f233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Flow 'volume_create_manager' (cc56e2b9-50a5-4f56-9b22-d804fb770ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c4d45ef0-8276-4f1a-a271-2de482e7954e tempest-TestMinimumBasicScenario-2102766644 None] Created volume successfully. Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-3aed15c1-8702-4be2-801b-41b12bdf8a31" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-3aed15c1-8702-4be2-801b-41b12bdf8a31" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[273f937a-1206-42ba-bc0e-c8d891ed51a4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (f52ccc89-ca87-4dfc-95d5-ba2574271239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011b0b6f-a7f2-4502-9a33-db0441388a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011b0b6f-a7f2-4502-9a33-db0441388a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-581860168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa786994-36bb-49fa-8140-88604cd68957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:13Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f406fac-0dae-4515-905d-3503b023d7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f406fac-0dae-4515-905d-3503b023d7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c31240-38de-4957-a772-661599c3d719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6c31240-38de-4957-a772-661599c3d719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa786994-36bb-49fa-8140-88604cd68957', 'volume_name': 'volume-fa786994-36bb-49fa-8140-88604cd68957', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ed971f-dd94-407f-b31a-74eece849cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ed971f-dd94-407f-b31a-74eece849cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1815fc1-ed34-48d9-b6e7-c85ab39dffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Volume fa786994-36bb-49fa-8140-88604cd68957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa786994-36bb-49fa-8140-88604cd68957', 'volume_size': 1} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-581860168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa786994-36bb-49fa-8140-88604cd68957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:13Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Creating volume fa786994-36bb-49fa-8140-88604cd68957 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:13 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 Nov 02 17:58:13 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:13 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:13 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 1073741824 Nov 02 17:58:13 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:13 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:13 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31 Nov 02 17:58:13 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:13 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 1073741824" returned: 0 in 0.690s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:13 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3aed15c1-8702-4be2-801b-41b12bdf8a31" returned: 0 in 0.423s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-3aed15c1-8702-4be2-801b-41b12bdf8a31" released by "delete_volume" :: held 0.968s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:13 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 Nov 02 17:58:13 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['b693986f-c3a3-49d1-aafa-ca712d8f7207'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:14 devstack cinder-volume[86585]: WARNING cinder.quota [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1513195644 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1513195644, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:58:14 devstack cinder-volume[86585]: WARNING cinder.quota [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1513195644 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1513195644, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['cc6a5626-07a8-48a4-99cb-de17d22e085f', '22f08cb6-515d-4a4d-a111-27ddef076113', '142c1c61-16a6-411a-8a3f-df999935c3df', '19bc5a84-ae93-4edb-8bb5-2ebbf0cba170'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:14 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:14 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:14 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957" returned: 0 in 0.424s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1815fc1-ed34-48d9-b6e7-c85ab39dffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa786994-36bb-49fa-8140-88604cd68957', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeabb9c-e433-4be6-a07d-0caf50a6389d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:14 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Volume volume-fa786994-36bb-49fa-8140-88604cd68957 (fa786994-36bb-49fa-8140-88604cd68957): created successfully Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aeabb9c-e433-4be6-a07d-0caf50a6389d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (f52ccc89-ca87-4dfc-95d5-ba2574271239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-385ca1b5-408b-462a-a145-1f6bc2c3f976 tempest-VolumesActionsTest-906096550 None] Created volume successfully. Nov 02 17:58:14 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.356s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-368f5e4c-4f85-468a-a77d-cd9522992f13 tempest-GroupSnapshotsTest-1073459792 None] Delete group completed successfully. Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-a07cbbe3-3c72-4540-be22-0eba5a22bebd req-cbd48b65-dca5-4b51-bcbf-cc52ce26b8d9 tempest-TestMinimumBasicScenario-2102766644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-a07cbbe3-3c72-4540-be22-0eba5a22bebd req-cbd48b65-dca5-4b51-bcbf-cc52ce26b8d9 tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-a07cbbe3-3c72-4540-be22-0eba5a22bebd req-cbd48b65-dca5-4b51-bcbf-cc52ce26b8d9 tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-a07cbbe3-3c72-4540-be22-0eba5a22bebd req-cbd48b65-dca5-4b51-bcbf-cc52ce26b8d9 tempest-TestMinimumBasicScenario-2102766644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '716104d4-fc5d-4744-8dfe-719178ff7b30', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:58:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-a07cbbe3-3c72-4540-be22-0eba5a22bebd req-cbd48b65-dca5-4b51-bcbf-cc52ce26b8d9 tempest-TestMinimumBasicScenario-2102766644 None] attachment_update completed successfully. Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-fa786994-36bb-49fa-8140-88604cd68957-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Lock "cinder-fa786994-36bb-49fa-8140-88604cd68957-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 0449ea46-aed1-43ae-870c-fa0b4164d5aa: deleting Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-quobyte-fa786994-36bb-49fa-8140-88604cd68957" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 0449ea46-aed1-43ae-870c-fa0b4164d5aa: deleting {{(pid=86585) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-fa786994-36bb-49fa-8140-88604cd68957" acquired by "delete_volume" :: waited 0.052s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-1b3f4c1c-c59a-4962-9bce-df49efe82678" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f45115b-b530-4fdf-bbef-df016fe17aa1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-1b3f4c1c-c59a-4962-9bce-df49efe82678" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Deleting offline snapshot 4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 of volume 1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] snapshot_file for this snap is: volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb897e75-bb67-4ec9-8ff0-406596ea0ee3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:16 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 Nov 02 17:58:16 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:16 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 Nov 02 17:58:16 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:16 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957" returned: 0 in 0.757s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:16 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" returned: 0 in 0.618s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b3f4c1c-c59a-4962-9bce-df49efe82678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:58:16 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957 Nov 02 17:58:16 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[988e1164-32f2-48cf-842a-f6287ea6a100]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:16 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 Nov 02 17:58:16 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:17 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa786994-36bb-49fa-8140-88604cd68957" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-fa786994-36bb-49fa-8140-88604cd68957" released by "delete_volume" :: held 1.320s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Created reservations ['8bc1eb27-ca57-4679-9fc9-304b02deb581', '70d69ca2-3150-46c2-85aa-4e298486682b', '47777e20-28de-443d-8c3e-c4aca86d9fd7', '7d9b1e9b-fd56-4e96-a3e0-3c63b615aa3c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:17 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:17 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:17 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.290s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Deleted volume successfully. Nov 02 17:58:17 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d16a21bd-3df0-4cde-bef7-f00308a37fe6 tempest-VolumesActionsTest-416294580 None] Lock "cinder-fa786994-36bb-49fa-8140-88604cd68957-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678" returned: 0 in 0.947s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:17 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 Nov 02 17:58:17 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:18 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" returned: 0 in 0.443s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:18 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240 Nov 02 17:58:18 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:18 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678.4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" returned: 0 in 0.302s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-4b18aa0d-aa32-4068-aff3-c8e7aa6ea240" released by "_delete_snapshot" :: held 2.506s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-1b3f4c1c-c59a-4962-9bce-df49efe82678" released by "delete_snapshot" :: held 2.553s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:18 devstack cinder-volume[86585]: WARNING cinder.quota [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1513195644 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1513195644, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['91766c08-9cf7-4bcd-8858-b2bcc875f489', '814855de-cecc-4069-8ed0-c639348d5c71', '5af6ab1d-4f82-4b75-9249-62bd568acac7', '1debdd5d-62fc-4075-a093-f9a18c479b14'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7c51fa97-169c-4bc5-a804-a6d976ad48d4 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 0449ea46-aed1-43ae-870c-fa0b4164d5aa: deleted successfully Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (fc453e29-4ae2-4bc4-9a38-fb67b521d4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ef440e-a16b-4f6e-bc20-337da28f18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ef440e-a16b-4f6e-bc20-337da28f18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96373904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006a8d52-45a4-4976-b29e-b10c519cf224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:19Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07638663-d1e6-45d2-9388-dc9f922632c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07638663-d1e6-45d2-9388-dc9f922632c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c1efa4-bc4b-40c3-81c5-562a2a2af85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c1efa4-bc4b-40c3-81c5-562a2a2af85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006a8d52-45a4-4976-b29e-b10c519cf224', 'volume_name': 'volume-006a8d52-45a4-4976-b29e-b10c519cf224', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cdc7e3-0942-4277-89c2-e38020b8fdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57cdc7e3-0942-4277-89c2-e38020b8fdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7fd053-9971-45d0-bb86-eafa0dea1299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Volume 006a8d52-45a4-4976-b29e-b10c519cf224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006a8d52-45a4-4976-b29e-b10c519cf224', 'volume_size': 1} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96373904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006a8d52-45a4-4976-b29e-b10c519cf224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:19Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Creating volume 006a8d52-45a4-4976-b29e-b10c519cf224 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:18 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:18 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 1073741824 Nov 02 17:58:18 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:19 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 1073741824" returned: 0 in 0.588s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:19 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 Nov 02 17:58:19 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=89,cinder:INSERT=22,cinder:UPDATE=90,cinder:DELETE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-1b3f4c1c-c59a-4962-9bce-df49efe82678" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-1b3f4c1c-c59a-4962-9bce-df49efe82678" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68d38a-926f-4a30-a229-6229a4fee749]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:19 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224" returned: 0 in 0.395s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7fd053-9971-45d0-bb86-eafa0dea1299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006a8d52-45a4-4976-b29e-b10c519cf224', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a35c0a-6d83-4d79-9e49-08a513316f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:19 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Volume volume-006a8d52-45a4-4976-b29e-b10c519cf224 (006a8d52-45a4-4976-b29e-b10c519cf224): created successfully Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a35c0a-6d83-4d79-9e49-08a513316f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (fc453e29-4ae2-4bc4-9a38-fb67b521d4e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ecd67797-6752-4ff3-a198-2f5a93336584 tempest-VolumesActionsTest-906096550 None] Created volume successfully. Nov 02 17:58:20 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 Nov 02 17:58:20 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:20 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678" returned: 0 in 0.450s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:20 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678 Nov 02 17:58:20 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:20 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1b3f4c1c-c59a-4962-9bce-df49efe82678" returned: 0 in 0.290s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-1b3f4c1c-c59a-4962-9bce-df49efe82678" released by "delete_volume" :: held 0.852s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=80,cinder:SELECT=83,cinder:DELETE=8,cinder:INSERT=18 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['60937354-ecaf-4c9f-864d-80e967a842da'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:20 devstack cinder-volume[86585]: WARNING cinder.db.api [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1513195644'] Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['795800de-b34a-4a35-a8f7-4acb5b690465', 'ad741fa8-e099-4cc1-8d80-a943e342d47e', '8522e576-5e9b-47a0-b689-a3a44060ec20', 'e686c3ba-2da3-457c-bc89-c87f66de5761'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:21 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:21 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-006a8d52-45a4-4976-b29e-b10c519cf224-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Lock "cinder-006a8d52-45a4-4976-b29e-b10c519cf224-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-quobyte-006a8d52-45a4-4976-b29e-b10c519cf224" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-006a8d52-45a4-4976-b29e-b10c519cf224" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b421ded0-1b9d-4422-b2d1-d441a8a0c51f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:21 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.546s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:21 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1966759f-7930-4b6e-bf5d-8b1a4f9a6112 tempest-GroupSnapshotsTest-1073459792 None] Delete group completed successfully. Nov 02 17:58:21 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 Nov 02 17:58:21 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c4c71d24-603b-46d8-aaf3-014c2f653f70 tempest-GroupSnapshotsTest-1073459792 None] Group tempest-GroupSnapshotsTest-Group-445067074: creating Nov 02 17:58:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c4c71d24-603b-46d8-aaf3-014c2f653f70 tempest-GroupSnapshotsTest-1073459792 None] Group tempest-GroupSnapshotsTest-Group-445067074: created successfully Nov 02 17:58:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c4c71d24-603b-46d8-aaf3-014c2f653f70 tempest-GroupSnapshotsTest-1073459792 None] Create group completed successfully. Nov 02 17:58:22 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224" returned: 0 in 0.553s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:22 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224 Nov 02 17:58:22 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:22 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-006a8d52-45a4-4976-b29e-b10c519cf224" returned: 0 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-006a8d52-45a4-4976-b29e-b10c519cf224" released by "delete_volume" :: held 1.045s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Created reservations ['ed262e90-b4d4-4d67-a534-4406e3c45425', 'e418ffad-c222-4564-a6db-7e12e419db17', 'c86869c5-9faa-4d09-812b-f5ff71ef8eb7', '35d5b2e7-78d5-4914-bbf6-b8a5ae3d12a7'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:22 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:22 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:22 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:22 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Deleted volume successfully. Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f75e43c1-dddb-4cd9-8e7c-fbcfce83cae7 tempest-VolumesActionsTest-416294580 None] Lock "cinder-006a8d52-45a4-4976-b29e-b10c519cf224-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (65b5053d-5242-4a3b-a9c9-892c5357b6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8a3a3d-7fb3-41b9-af32-08f1040bc4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8a3a3d-7fb3-41b9-af32-08f1040bc4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922006526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1ea7d6e-57d0-408b-b46d-4213985dc337,host='devstack@QuobyteHD#QuobyteHD',id=f879ff15-8501-4464-89a8-fafb3c9952d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:24Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df929155-a498-4bc6-ad8d-7a638f6ef769),volume_type_id=df929155-a498-4bc6-ad8d-7a638f6ef769)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cd32dd-b04c-475b-9b27-7b57b6a916b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80cd32dd-b04c-475b-9b27-7b57b6a916b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4c83a9-a940-4127-ab6c-15e9f4e0383a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e4c83a9-a940-4127-ab6c-15e9f4e0383a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f879ff15-8501-4464-89a8-fafb3c9952d0', 'volume_name': 'volume-f879ff15-8501-4464-89a8-fafb3c9952d0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5511474-8c04-422e-975d-56322e87a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5511474-8c04-422e-975d-56322e87a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9f119b-7787-4e9b-88aa-8afb80c4feee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:23 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Volume f879ff15-8501-4464-89a8-fafb3c9952d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f879ff15-8501-4464-89a8-fafb3c9952d0', 'volume_size': 1} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1ea7d6e-57d0-408b-b46d-4213985dc337,created_at=2026-11-02T16:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1922006526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1ea7d6e-57d0-408b-b46d-4213985dc337,host='devstack@QuobyteHD#QuobyteHD',id=f879ff15-8501-4464-89a8-fafb3c9952d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:24Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df929155-a498-4bc6-ad8d-7a638f6ef769),volume_type_id=df929155-a498-4bc6-ad8d-7a638f6ef769)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Creating volume f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:23 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:23 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 1073741824 Nov 02 17:58:23 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:24 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 1073741824" returned: 0 in 0.646s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:24 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 Nov 02 17:58:24 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (9054d3af-30b4-4b86-99ce-d5f17bc71ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bd9558-d53b-4f5a-b54a-0220c783d2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8bd9558-d53b-4f5a-b54a-0220c783d2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575516175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642ff324-d0cd-4d4e-b761-745e64137e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:24Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6984deb4-022b-4729-a551-1c4b18f77bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6984deb4-022b-4729-a551-1c4b18f77bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb53ad72-ff9c-40a9-b800-90251c2b4e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb53ad72-ff9c-40a9-b800-90251c2b4e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642ff324-d0cd-4d4e-b761-745e64137e63', 'volume_name': 'volume-642ff324-d0cd-4d4e-b761-745e64137e63', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63984247-e421-4dcb-b35c-6eba4ed73b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63984247-e421-4dcb-b35c-6eba4ed73b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40f4a41-9491-4f25-9187-152e66428368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Volume 642ff324-d0cd-4d4e-b761-745e64137e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642ff324-d0cd-4d4e-b761-745e64137e63', 'volume_size': 1} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:24 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0" returned: 0 in 0.374s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.218s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575516175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642ff324-d0cd-4d4e-b761-745e64137e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:24Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Creating volume 642ff324-d0cd-4d4e-b761-745e64137e63 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:24 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf9f119b-7787-4e9b-88aa-8afb80c4feee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f879ff15-8501-4464-89a8-fafb3c9952d0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:24 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 1073741824 Nov 02 17:58:24 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dfa639-be7f-4048-b181-67b3351a3f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Volume volume-f879ff15-8501-4464-89a8-fafb3c9952d0 (f879ff15-8501-4464-89a8-fafb3c9952d0): created successfully Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8dfa639-be7f-4048-b181-67b3351a3f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (65b5053d-5242-4a3b-a9c9-892c5357b6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-fd42acc9-deec-46b3-98e9-4af1152c4488 tempest-GroupSnapshotsTest-1073459792 None] Created volume successfully. Nov 02 17:58:25 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 1073741824" returned: 0 in 0.602s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:25 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 Nov 02 17:58:25 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:25 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63" returned: 0 in 0.255s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f40f4a41-9491-4f25-9187-152e66428368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642ff324-d0cd-4d4e-b761-745e64137e63', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0329131e-9da7-466a-b33d-e939575925b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Volume volume-642ff324-d0cd-4d4e-b761-745e64137e63 (642ff324-d0cd-4d4e-b761-745e64137e63): created successfully Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0329131e-9da7-466a-b33d-e939575925b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (9054d3af-30b4-4b86-99ce-d5f17bc71ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-95574267-23fd-4521-8420-203455d5ca66 tempest-VolumesActionsTest-906096550 None] Created volume successfully. Nov 02 17:58:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-642ff324-d0cd-4d4e-b761-745e64137e63-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Lock "cinder-642ff324-d0cd-4d4e-b761-745e64137e63-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-quobyte-642ff324-d0cd-4d4e-b761-745e64137e63" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-642ff324-d0cd-4d4e-b761-745e64137e63" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0107975f-9055-4374-bc68-662877b291a7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:27 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 Nov 02 17:58:27 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (4532ebe2-6fc1-46b3-a7a7-311800a17287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bedf46a-dfe5-445d-9f06-0b9689ed0148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bedf46a-dfe5-445d-9f06-0b9689ed0148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473385001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1ea7d6e-57d0-408b-b46d-4213985dc337,host='devstack@QuobyteHD#QuobyteHD',id=b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:27Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df929155-a498-4bc6-ad8d-7a638f6ef769),volume_type_id=df929155-a498-4bc6-ad8d-7a638f6ef769)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c280c5e-e706-49ca-8b2e-66c408d17be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c280c5e-e706-49ca-8b2e-66c408d17be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b628cc-98ac-4097-94ad-ec9ab15055a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b628cc-98ac-4097-94ad-ec9ab15055a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb', 'volume_name': 'volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189a74ea-90ae-440c-b5f1-3c14887b97d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (189a74ea-90ae-440c-b5f1-3c14887b97d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f84974-2495-4c64-9898-c612a7838724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Volume b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb', 'volume_size': 1} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1ea7d6e-57d0-408b-b46d-4213985dc337,created_at=2026-11-02T16:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473385001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1ea7d6e-57d0-408b-b46d-4213985dc337,host='devstack@QuobyteHD#QuobyteHD',id=b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:27Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df929155-a498-4bc6-ad8d-7a638f6ef769),volume_type_id=df929155-a498-4bc6-ad8d-7a638f6ef769)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Creating volume b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:27 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb 1073741824 Nov 02 17:58:27 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:27 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63" returned: 0 in 0.661s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:27 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63 Nov 02 17:58:27 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:28 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb 1073741824" returned: 0 in 0.571s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:28 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-642ff324-d0cd-4d4e-b761-745e64137e63" returned: 0 in 0.347s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:28 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb Nov 02 17:58:28 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-642ff324-d0cd-4d4e-b761-745e64137e63" released by "delete_volume" :: held 1.100s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Created reservations ['72669b19-a790-41ef-ab6a-403aa7564c8f', '940299b2-cddc-4673-81e5-5d701564e894', '074ccb3c-44c5-4c65-8c37-85aa539cd55b', '9f644df6-0f92-4c0f-9ae7-8a3b40a5a368'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:28 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:28 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:28 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" returned: 0 in 0.370s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f84974-2495-4c64-9898-c612a7838724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16bb8ec-46c1-4796-8e6a-493320d92870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Volume volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb (b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb): created successfully Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a16bb8ec-46c1-4796-8e6a-493320d92870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (4532ebe2-6fc1-46b3-a7a7-311800a17287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ae50f22a-2ee0-4e2c-ab81-cb174bddfd98 tempest-GroupSnapshotsTest-1073459792 None] Created volume successfully. Nov 02 17:58:28 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.309s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Deleted volume successfully. Nov 02 17:58:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2a05119c-1e07-4f3e-8dd3-8489f1de4f3e tempest-VolumesActionsTest-416294580 None] Lock "cinder-642ff324-d0cd-4d4e-b761-745e64137e63-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dd52ef32-79f8-41b2-b96c-a2cd673247f9 tempest-GroupSnapshotsTest-1073459792 None] Update group completed successfully. Nov 02 17:58:29 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (c1c01b6c-6c0c-4c8d-968a-7242ea23e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a11e694-a284-4c8c-b7a1-9838c951d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a11e694-a284-4c8c-b7a1-9838c951d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899885192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80a21ca-69fc-47b4-902d-f738cc1a979d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:30Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5beb0382-f6a4-4eb2-8a37-6a1f56a516a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5beb0382-f6a4-4eb2-8a37-6a1f56a516a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed0bed6-d69d-4e56-b30e-5e656e0df806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed0bed6-d69d-4e56-b30e-5e656e0df806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80a21ca-69fc-47b4-902d-f738cc1a979d', 'volume_name': 'volume-e80a21ca-69fc-47b4-902d-f738cc1a979d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7662bc36-d1b5-44e6-87be-24fbe3a14bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7662bc36-d1b5-44e6-87be-24fbe3a14bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d69e4ca-ba7a-4b78-9ebf-0d6704ee2b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Volume e80a21ca-69fc-47b4-902d-f738cc1a979d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80a21ca-69fc-47b4-902d-f738cc1a979d', 'volume_size': 1} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1899885192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80a21ca-69fc-47b4-902d-f738cc1a979d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:30Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Creating volume e80a21ca-69fc-47b4-902d-f738cc1a979d {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:30 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:30 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d 1073741824 Nov 02 17:58:30 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-49001a6d-2845-481b-8a95-8760d53bbb9f tempest-GroupSnapshotsTest-1073459792 None] Update group completed successfully. Nov 02 17:58:30 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d 1073741824" returned: 0 in 0.500s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:30 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d Nov 02 17:58:30 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:30 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d69e4ca-ba7a-4b78-9ebf-0d6704ee2b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80a21ca-69fc-47b4-902d-f738cc1a979d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd2939a-78ea-4a60-82b6-948df1f9d9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Volume volume-e80a21ca-69fc-47b4-902d-f738cc1a979d (e80a21ca-69fc-47b4-902d-f738cc1a979d): created successfully Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd2939a-78ea-4a60-82b6-948df1f9d9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (c1c01b6c-6c0c-4c8d-968a-7242ea23e67b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c4669e28-4c1e-41b6-8a55-f0bfc9f6d21a tempest-VolumesActionsTest-906096550 None] Created volume successfully. Nov 02 17:58:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ef97dbaf-c255-4304-80f6-2bab82c55fbd tempest-GroupSnapshotsTest-1073459792 None] Update group completed successfully. Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-e80a21ca-69fc-47b4-902d-f738cc1a979d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Lock "cinder-e80a21ca-69fc-47b4-902d-f738cc1a979d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Acquiring lock "cinder-quobyte-e80a21ca-69fc-47b4-902d-f738cc1a979d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-e80a21ca-69fc-47b4-902d-f738cc1a979d" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b8d456-21ed-4c68-9aeb-7f16ea12204e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:32 devstack sudo[100528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d Nov 02 17:58:32 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dfc35410-0259-4b24-8d0d-1f5c06d471ce tempest-GroupSnapshotsTest-1073459792 None] Update group completed successfully. Nov 02 17:58:32 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d" returned: 0 in 0.527s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:32 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d Nov 02 17:58:32 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:33 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e80a21ca-69fc-47b4-902d-f738cc1a979d" returned: 0 in 0.260s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Lock "cinder-quobyte-e80a21ca-69fc-47b4-902d-f738cc1a979d" released by "delete_volume" :: held 0.836s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Created reservations ['7bbf05d7-053e-49a1-b492-8163be53335b', 'c9d6aa51-19bb-4c1c-bd7e-43f6d527f285', '73431e23-6bab-4910-af2a-9dbf92e2c5b9', 'af8ee12e-8f4f-4a2b-a828-4c636df77ce4'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:33 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:33 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:33 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Deleted volume successfully. Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1ea08790-b7b8-4cf6-840c-855f84809191 tempest-VolumesActionsTest-416294580 None] Lock "cinder-e80a21ca-69fc-47b4-902d-f738cc1a979d-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (56944248-ecee-4f5b-bcef-031f05b0a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b4a89e-ceb5-4181-92e4-fe24d34c98f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0b4a89e-ceb5-4181-92e4-fe24d34c98f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-594338262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b568e9ac-ca02-4f86-b629-0295ad332545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:34Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e59ae5-2315-48ba-a4f5-165e2d9c0348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e59ae5-2315-48ba-a4f5-165e2d9c0348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb53a671-5bd8-47ac-89a7-13b884cbface) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb53a671-5bd8-47ac-89a7-13b884cbface) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b568e9ac-ca02-4f86-b629-0295ad332545', 'volume_name': 'volume-b568e9ac-ca02-4f86-b629-0295ad332545', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0127ad4a-1ea2-43f5-a773-873aed6330b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0127ad4a-1ea2-43f5-a773-873aed6330b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711c60e1-b1a7-40c3-82e1-bdb5a84ac2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Volume b568e9ac-ca02-4f86-b629-0295ad332545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b568e9ac-ca02-4f86-b629-0295ad332545', 'volume_size': 1} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-594338262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b568e9ac-ca02-4f86-b629-0295ad332545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b4858df959425b9bcb71af658c64e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:34Z,use_quota=True,user_id='bae4dc7680dd4362af5faa69d35fff66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Creating volume b568e9ac-ca02-4f86-b629-0295ad332545 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:34 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:34 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 1073741824 Nov 02 17:58:34 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] GroupSnapshot 663d5674-5143-4808-aa91-ca2dc32adf62: creating. Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Group snapshot 663d5674-5143-4808-aa91-ca2dc32adf62: creating. {{(pid=86585) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:34 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 1073741824" returned: 0 in 0.577s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:34 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 Nov 02 17:58:34 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:35 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545" returned: 0 in 0.349s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.691s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (711c60e1-b1a7-40c3-82e1-bdb5a84ac2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b568e9ac-ca02-4f86-b629-0295ad332545', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463e08dc-8b0e-4bf6-b5f0-5182901b56c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Creating offline snapshot 32844312-4df6-4622-b0f2-944984c1a9d6 of volume b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:58:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Volume volume-b568e9ac-ca02-4f86-b629-0295ad332545 (b568e9ac-ca02-4f86-b629-0295ad332545): created successfully Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463e08dc-8b0e-4bf6-b5f0-5182901b56c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Flow 'volume_create_manager' (56944248-ecee-4f5b-bcef-031f05b0a414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[781857d8-a56d-47e3-ab9b-0441804c2695]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c628f934-bdc1-4b11-8169-91d3c2a9b6d9 tempest-VolumesActionsTest-906096550 None] Created volume successfully. Nov 02 17:58:35 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb Nov 02 17:58:35 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:35 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" returned: 0 in 0.458s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:35 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 1G Nov 02 17:58:35 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:36 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 1G" returned: 0 in 0.469s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:36 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 Nov 02 17:58:36 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:36 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6" returned: 0 in 0.335s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:36 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:36 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 Nov 02 17:58:36 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:36 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6" returned: 0 in 0.305s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:36 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info Nov 02 17:58:36 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Acquiring lock "cinder-b568e9ac-ca02-4f86-b629-0295ad332545-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Lock "cinder-b568e9ac-ca02-4f86-b629-0295ad332545-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Acquiring lock "cinder-quobyte-b568e9ac-ca02-4f86-b629-0295ad332545" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Lock "cinder-quobyte-b568e9ac-ca02-4f86-b629-0295ad332545" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc98fc56-c5fd-4c69-a129-62cc97dd83ce]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:37 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 Nov 02 17:58:37 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:37 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info" returned: 0 in 0.379s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:37 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:37 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info Nov 02 17:58:37 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:37 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545" returned: 0 in 0.400s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:37 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545 Nov 02 17:58:37 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:37 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.info" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Creating offline snapshot f0f19483-76b2-42ab-ae49-8b3363959e4a of volume f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[63091ec8-cf56-4897-8cfa-a227c2e06556]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:37 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 Nov 02 17:58:37 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:37 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b568e9ac-ca02-4f86-b629-0295ad332545" returned: 0 in 0.303s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Lock "cinder-quobyte-b568e9ac-ca02-4f86-b629-0295ad332545" released by "delete_volume" :: held 0.757s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Created reservations ['fb5e153f-2eb7-4c13-8d4b-d4f33d2743d5', 'f2638767-325d-4a2c-aa89-0c32fb10d1a1', '8d3839ce-5c1f-4f9c-a151-568db72a785a', 'c1090513-eeb9-471b-9fea-530039470187'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:37 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:37 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:37 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0" returned: 0 in 0.425s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:37 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a 1G Nov 02 17:58:37 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:38 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.338s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Deleted volume successfully. Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4807cffe-1103-4080-8e24-d0709c8739ce tempest-VolumesActionsTest-906096550 None] Lock "cinder-b568e9ac-ca02-4f86-b629-0295ad332545-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:38 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a 1G" returned: 0 in 0.543s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f879ff15-8501-4464-89a8-fafb3c9952d0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:38 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f879ff15-8501-4464-89a8-fafb3c9952d0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a Nov 02 17:58:38 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Flow 'volume_create_manager' (de99a5d1-25be-421b-81ea-d19745b20b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46a8351-cc9d-46f4-8b50-fe6afb69a6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46a8351-cc9d-46f4-8b50-fe6afb69a6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1656280247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d872752-d681-424c-9dae-e604f72992c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd978917aa7342cebb3ff3ee01959f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:39Z,use_quota=True,user_id='737dae73a9bf4cc9b148d4a733779305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e913693b-c8e3-41bf-8a00-972ba3263593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e913693b-c8e3-41bf-8a00-972ba3263593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2fed52-40f3-4377-9c55-d0e42b90586d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2fed52-40f3-4377-9c55-d0e42b90586d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d872752-d681-424c-9dae-e604f72992c7', 'volume_name': 'volume-4d872752-d681-424c-9dae-e604f72992c7', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e388e57-c46c-4017-b4cb-d6e1ebe836f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e388e57-c46c-4017-b4cb-d6e1ebe836f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a489c0-a75d-4808-b23d-25512ea6fd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:38 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Volume 4d872752-d681-424c-9dae-e604f72992c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d872752-d681-424c-9dae-e604f72992c7', 'volume_size': 1} Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:38 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f879ff15-8501-4464-89a8-fafb3c9952d0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a" returned: 0 in 0.451s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:38 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:58:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:38 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a Nov 02 17:58:38 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:39 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:39 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info Nov 02 17:58:39 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:39 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info" returned: 0 in 0.483s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:39 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:58:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:39 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info Nov 02 17:58:39 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:40 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.info" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.739s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.378s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1656280247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d872752-d681-424c-9dae-e604f72992c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd978917aa7342cebb3ff3ee01959f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:39Z,use_quota=True,user_id='737dae73a9bf4cc9b148d4a733779305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Creating volume 4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:40 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:40 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 1073741824 Nov 02 17:58:40 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bf78a028-4b91-4c64-bf6f-2946f51cd11d tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 663d5674-5143-4808-aa91-ca2dc32adf62: created successfully Nov 02 17:58:40 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 1073741824" returned: 0 in 0.556s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:40 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 Nov 02 17:58:40 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 663d5674-5143-4808-aa91-ca2dc32adf62: deleting Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 663d5674-5143-4808-aa91-ca2dc32adf62: deleting {{(pid=86585) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-32844312-4df6-4622-b0f2-944984c1a9d6" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-32844312-4df6-4622-b0f2-944984c1a9d6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Deleting offline snapshot 32844312-4df6-4622-b0f2-944984c1a9d6 of volume b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] snapshot_file for this snap is: volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2f0a16-809f-4613-acb4-bbaff50b3ac8]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:41 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7" returned: 0 in 0.526s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a489c0-a75d-4808-b23d-25512ea6fd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d872752-d681-424c-9dae-e604f72992c7', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e50604-d0bc-47f3-b7ee-07a800992fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:41 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Volume volume-4d872752-d681-424c-9dae-e604f72992c7 (4d872752-d681-424c-9dae-e604f72992c7): created successfully Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e50604-d0bc-47f3-b7ee-07a800992fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Flow 'volume_create_manager' (de99a5d1-25be-421b-81ea-d19745b20b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6643dcfe-50de-4d0f-a1de-ab3c5876ab27 tempest-TestStampPattern-201362744 None] Created volume successfully. Nov 02 17:58:41 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 Nov 02 17:58:41 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:41 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6" returned: 0 in 0.580s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3662a3-f22a-4555-9bd0-9b1a2e69dc90]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:41 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb Nov 02 17:58:41 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:42 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" returned: 0 in 0.443s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:42 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 Nov 02 17:58:42 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:42 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6" returned: 0 in 0.653s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:42 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6 Nov 02 17:58:42 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:43 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb.32844312-4df6-4622-b0f2-944984c1a9d6" returned: 0 in 0.359s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-32844312-4df6-4622-b0f2-944984c1a9d6" released by "_delete_snapshot" :: held 2.211s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" released by "delete_snapshot" :: held 2.251s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-f879ff15-8501-4464-89a8-fafb3c9952d0" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-f879ff15-8501-4464-89a8-fafb3c9952d0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-f0f19483-76b2-42ab-ae49-8b3363959e4a" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-f0f19483-76b2-42ab-ae49-8b3363959e4a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Deleting offline snapshot f0f19483-76b2-42ab-ae49-8b3363959e4a of volume f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] snapshot_file for this snap is: volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56c5df-d96a-4780-be17-67b87e4f8b8d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:43 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a Nov 02 17:58:43 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:43 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a" returned: 0 in 0.542s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f879ff15-8501-4464-89a8-fafb3c9952d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:58:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1fc7bf-7352-443d-95a1-616a9e725d77]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:44 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 Nov 02 17:58:44 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:44 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0" returned: 0 in 0.557s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:44 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a Nov 02 17:58:44 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:45 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a" returned: 0 in 0.620s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:45 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a Nov 02 17:58:45 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:45 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0.f0f19483-76b2-42ab-ae49-8b3363959e4a" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-f0f19483-76b2-42ab-ae49-8b3363959e4a" released by "_delete_snapshot" :: held 2.381s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-f879ff15-8501-4464-89a8-fafb3c9952d0" released by "delete_snapshot" :: held 2.416s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:46 devstack cinder-volume[86585]: WARNING cinder.quota [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-972913983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-972913983, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:58:46 devstack cinder-volume[86585]: WARNING cinder.quota [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-972913983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-972913983, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['62c63e92-98e0-4df2-9356-018ec45d46ff', 'ef167e88-cd43-42d5-97c8-c3030bfad3f6', '3b0c863f-bc0d-4ab1-a5f8-a1678982c3bd', '590fc9ec-3bbc-4b78-a561-58f147da8ba8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['d26a603c-c001-4da1-965e-a91bd7313977', 'c268642c-24d1-4b2e-afba-5859b74308f0', 'cfd5f8f6-f609-421f-b0a5-d7838c43b886', '7614f788-4732-476e-8a66-892035529b57'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:46 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:46 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:46 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7eb9cb90-9316-471e-a747-44046f6ddc9e tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 663d5674-5143-4808-aa91-ca2dc32adf62: deleted successfully Nov 02 17:58:47 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.959s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:58:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:58:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:58:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:48 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8e0ee7-3632-4f38-96d5-218eb0eb96b1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:48 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb Nov 02 17:58:48 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:49 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" returned: 0 in 1.020s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:49 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb Nov 02 17:58:49 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:49 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" returned: 0 in 0.405s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b824d06b-a1cc-47da-8ebb-e0cd5d23d6cb" released by "delete_volume" :: held 1.628s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-f879ff15-8501-4464-89a8-fafb3c9952d0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-f879ff15-8501-4464-89a8-fafb3c9952d0" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca053c13-5f62-4bff-86dc-572776a89010]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:50 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 Nov 02 17:58:50 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:50 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0" returned: 0 in 0.686s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:50 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0 Nov 02 17:58:50 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:51 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f879ff15-8501-4464-89a8-fafb3c9952d0" returned: 0 in 0.548s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-f879ff15-8501-4464-89a8-fafb3c9952d0" released by "delete_volume" :: held 1.362s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['a70f348a-9075-4125-85fa-3fe61eacfa96'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:51 devstack cinder-volume[86585]: WARNING cinder.quota [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-972913983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-972913983, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['6b4a4920-89e9-4227-984d-b7f21b696fda', 'b7a8da01-d229-4ed4-9f0f-2dc49d1808b2', '20b9bad3-394b-4bde-8fca-964a3b7e1b88', '958b2f0e-295e-403a-bc6d-e51c089b134b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['b9d5406d-58a7-4ce1-991f-7d0d6f16e095', '83fc08c5-95b7-40f0-8d99-f00ac987998a', 'f1b5a46b-9944-4e0a-b301-8d93cbe4daaa', '42a96c80-1eca-4960-8cdd-2cfbb52efcf2'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:51 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:58:51 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:52 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.648s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:52 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:58:52 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-81a40c7e-7ced-495a-97dd-b13e13df79b5 tempest-GroupSnapshotsTest-1073459792 None] Delete group completed successfully. Nov 02 17:58:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-68038038-0b4a-4595-8a21-fa62626c33af tempest-GroupSnapshotsTest-1073459792 None] Group tempest-GroupSnapshotsTest-Group-427166308: creating Nov 02 17:58:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-68038038-0b4a-4595-8a21-fa62626c33af tempest-GroupSnapshotsTest-1073459792 None] Group tempest-GroupSnapshotsTest-Group-427166308: created successfully Nov 02 17:58:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-68038038-0b4a-4595-8a21-fa62626c33af tempest-GroupSnapshotsTest-1073459792 None] Create group completed successfully. Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (c964da08-7181-41f4-b884-fde7c586709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0410d9b-5226-45fa-b98c-1c360e9cd066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0410d9b-5226-45fa-b98c-1c360e9cd066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392958521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bbfbcd7-d676-46d1-9252-0472e80735e1,host='devstack@QuobyteHD#QuobyteHD',id=b2106985-d108-4259-9504-b9dc1916b074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:55Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3aeab9a-f337-4fe6-9f93-da42bfe80d91),volume_type_id=d3aeab9a-f337-4fe6-9f93-da42bfe80d91)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e52e27-c356-47c5-897f-670c3b740c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e52e27-c356-47c5-897f-670c3b740c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af60c2d9-2588-4fa3-9b81-ed0752e0f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af60c2d9-2588-4fa3-9b81-ed0752e0f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2106985-d108-4259-9504-b9dc1916b074', 'volume_name': 'volume-b2106985-d108-4259-9504-b9dc1916b074', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceb3462-55fe-487a-a845-0565214cc708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aceb3462-55fe-487a-a845-0565214cc708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a802081b-4ea8-4661-a153-70d0c988c8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:55 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Volume b2106985-d108-4259-9504-b9dc1916b074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2106985-d108-4259-9504-b9dc1916b074', 'volume_size': 1} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7bbfbcd7-d676-46d1-9252-0472e80735e1,created_at=2026-11-02T16:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392958521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7bbfbcd7-d676-46d1-9252-0472e80735e1,host='devstack@QuobyteHD#QuobyteHD',id=b2106985-d108-4259-9504-b9dc1916b074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa78ee47e654b00b9361ed045b0cead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:58:55Z,use_quota=True,user_id='e01042d4938644e190d0b084fc92133c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3aeab9a-f337-4fe6-9f93-da42bfe80d91),volume_type_id=d3aeab9a-f337-4fe6-9f93-da42bfe80d91)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Creating volume b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:58:55 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:58:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:55 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 1073741824 Nov 02 17:58:55 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:56 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 1073741824" returned: 0 in 0.804s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:56 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 Nov 02 17:58:56 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:56 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074" returned: 0 in 0.490s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:58:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:58:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a802081b-4ea8-4661-a153-70d0c988c8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2106985-d108-4259-9504-b9dc1916b074', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd52db7d-dbde-443b-b6f4-275f1b33301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:58:57 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Volume volume-b2106985-d108-4259-9504-b9dc1916b074 (b2106985-d108-4259-9504-b9dc1916b074): created successfully Nov 02 17:58:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd52db7d-dbde-443b-b6f4-275f1b33301e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:58:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Flow 'volume_create_manager' (c964da08-7181-41f4-b884-fde7c586709a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:58:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-041fc241-7ca5-4001-8855-65033aa1a603 tempest-GroupSnapshotsTest-1073459792 None] Created volume successfully. Nov 02 17:58:58 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] GroupSnapshot 4432e781-e275-4380-a45e-bea3f3e0b072: creating. Nov 02 17:58:58 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Group snapshot 4432e781-e275-4380-a45e-bea3f3e0b072: creating. {{(pid=86585) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 17:58:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:58:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:58:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Creating offline snapshot dc2393b6-ba3f-4fe0-96df-236ae0f38d87 of volume b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:58:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9734b6d2-d265-4bae-8c60-d488514b5e32]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:58:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:58 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 Nov 02 17:58:58 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:59 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074" returned: 0 in 0.554s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:59 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 1G Nov 02 17:58:59 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:58:59 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 02 17:58:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 1G" returned: 0 in 0.491s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:58:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2106985-d108-4259-9504-b9dc1916b074 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:58:59 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2106985-d108-4259-9504-b9dc1916b074 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 Nov 02 17:58:59 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:00 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2106985-d108-4259-9504-b9dc1916b074 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87" returned: 0 in 0.339s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:00 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:00 devstack sudo[100864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 Nov 02 17:59:00 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:00 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:00 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info Nov 02 17:59:00 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:00 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info" returned: 0 in 0.266s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:00 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:00 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info Nov 02 17:59:00 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:00 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.info" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.330s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3943ae59-7e55-463a-86ad-6fd400dd2602 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 4432e781-e275-4380-a45e-bea3f3e0b072: created successfully Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Flow 'volume_create_manager' (7b7108aa-2ca8-4f3c-a4c0-2a514eece112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2ff3a0-23d7-4246-a3e4-4f1bcf5ddbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2ff3a0-23d7-4246-a3e4-4f1bcf5ddbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1111417874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51401d116674e138a06bb09314769db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:02Z,use_quota=True,user_id='a1625e73982e4f31ad62de5d3b1f6911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efca905-33e5-4a16-8e27-8b34f3ae2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2efca905-33e5-4a16-8e27-8b34f3ae2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02468e31-4479-4319-9fa7-368b4b82528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02468e31-4479-4319-9fa7-368b4b82528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf', 'volume_name': 'volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92ec434-63d9-4785-bbb7-d3045ed7b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92ec434-63d9-4785-bbb7-d3045ed7b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55e0899-abb4-41f5-bf35-b36c44c69d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Volume 19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf', 'volume_size': 1} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1111417874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51401d116674e138a06bb09314769db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:02Z,use_quota=True,user_id='a1625e73982e4f31ad62de5d3b1f6911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Creating volume 19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:01 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:01 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf 1073741824 Nov 02 17:59:01 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 4432e781-e275-4380-a45e-bea3f3e0b072: deleting Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 4432e781-e275-4380-a45e-bea3f3e0b072: deleting {{(pid=86585) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-b2106985-d108-4259-9504-b9dc1916b074" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b2106985-d108-4259-9504-b9dc1916b074" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-dc2393b6-ba3f-4fe0-96df-236ae0f38d87" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-dc2393b6-ba3f-4fe0-96df-236ae0f38d87" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Deleting offline snapshot dc2393b6-ba3f-4fe0-96df-236ae0f38d87 of volume b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] snapshot_file for this snap is: volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d5333-4238-40ab-a503-ecba34cd60f9]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:02 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 Nov 02 17:59:02 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:02 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf 1073741824" returned: 0 in 0.547s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:02 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf Nov 02 17:59:02 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:02 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2106985-d108-4259-9504-b9dc1916b074(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b7d932-ed12-428d-91c5-2a8ab9da26b6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:02 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf" returned: 0 in 0.315s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55e0899-abb4-41f5-bf35-b36c44c69d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f4dc6f-4ed5-4993-a586-f5c4639a3359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Volume volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf (19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf): created successfully Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f4dc6f-4ed5-4993-a586-f5c4639a3359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Flow 'volume_create_manager' (7b7108aa-2ca8-4f3c-a4c0-2a514eece112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5a183b48-905b-4482-9446-bf562277227a tempest-VolumesTransfersV355Test-203463445 None] Created volume successfully. Nov 02 17:59:02 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 Nov 02 17:59:02 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:02 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074" returned: 0 in 0.373s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:03 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 Nov 02 17:59:03 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:03 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:03 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87 Nov 02 17:59:03 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:03 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074.dc2393b6-ba3f-4fe0-96df-236ae0f38d87" returned: 0 in 0.240s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-dc2393b6-ba3f-4fe0-96df-236ae0f38d87" released by "_delete_snapshot" :: held 1.539s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b2106985-d108-4259-9504-b9dc1916b074" released by "delete_snapshot" :: held 1.564s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:03 devstack cinder-volume[86585]: WARNING cinder.quota [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-309605916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-309605916, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:03 devstack cinder-volume[86585]: WARNING cinder.quota [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-309605916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-309605916, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:03 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['d02671f0-fa20-4f73-860e-ed7a1b62f219', '58358507-3236-4eb9-8a47-2cc534b0fe5c', 'da624203-1092-428c-8cda-ff5844c00235', 'ccae24fb-1329-48f3-81dc-98d2c6716a4f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3f6d877a-f83e-4fef-9db8-2a9fc82491c6 tempest-GroupSnapshotsTest-1073459792 None] group_snapshot 4432e781-e275-4380-a45e-bea3f3e0b072: deleted successfully Nov 02 17:59:04 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5e7a10eb-178c-440c-aad5-f0ccf0433759 tempest-VolumesTransfersV355Test-65449727 None] Transfer volume completed successfully. Nov 02 17:59:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "cinder-quobyte-b2106985-d108-4259-9504-b9dc1916b074" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b2106985-d108-4259-9504-b9dc1916b074" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcb4380-6356-4d22-ae5f-b3e1159a7fe9]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:04 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 Nov 02 17:59:04 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Acquiring lock "cinder-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Acquiring lock "cinder-quobyte-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-quobyte-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[24568607-889a-47b5-9154-8761ea3e9871]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:05 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074" returned: 0 in 0.447s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:05 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074 Nov 02 17:59:05 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:05 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf Nov 02 17:59:05 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:05 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b2106985-d108-4259-9504-b9dc1916b074" returned: 0 in 0.298s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:05 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf" returned: 0 in 0.414s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Lock "cinder-quobyte-b2106985-d108-4259-9504-b9dc1916b074" released by "delete_volume" :: held 0.861s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:05 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf Nov 02 17:59:05 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['bb184b5e-b00d-4408-b1a0-51be3c2d35f8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:05 devstack cinder-volume[86585]: WARNING cinder.quota [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-309605916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-309605916, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Created reservations ['007ea8c8-c929-4d4f-9ae6-a10aa29fd0ba', '435c2dec-9b10-46b1-9dc1-e05279665b14', 'afa7ab97-d159-43a6-b2fc-c0d12edd49c3', '777d5cd8-2cea-4ab0-862a-70d9253dd25d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:05 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:05 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:05 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-quobyte-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf" released by "delete_volume" :: held 0.767s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Created reservations ['058d70ef-464a-4465-9428-ed54b7a7cb10', '182823fd-09c5-4d90-af57-30ae7033fb93', 'fdde8089-4e23-40ac-b931-30f6e4dc2bac', 'a5272608-b145-4272-8da5-b61df08f3d5e'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:06 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:06 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:06 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.344s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-82c4bfe5-c9f5-4527-81d6-5350ce52a7fd tempest-GroupSnapshotsTest-1073459792 None] Delete group completed successfully. Nov 02 17:59:06 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.312s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Deleted volume successfully. Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-22c8cac6-3d8b-4eb5-8359-70219e5ed3f1 tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-19cb0a16-8f0a-4cc8-a73e-1f39846d9eaf-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Flow 'volume_create_manager' (a2f9af85-dc7d-4f7a-a3a8-218f0ea966e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040cfd36-ff5e-44d4-ba8c-569cb4d9a357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040cfd36-ff5e-44d4-ba8c-569cb4d9a357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1379738182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865d95ce-0611-4e61-ae8e-d0400e34d3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51401d116674e138a06bb09314769db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:07Z,use_quota=True,user_id='a1625e73982e4f31ad62de5d3b1f6911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8399b95a-b4c1-4a3a-a755-1b9f38c15c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8399b95a-b4c1-4a3a-a755-1b9f38c15c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86937339-d61a-4e6c-86dc-d5ae3e327af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86937339-d61a-4e6c-86dc-d5ae3e327af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865d95ce-0611-4e61-ae8e-d0400e34d3b3', 'volume_name': 'volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3a67cf-1afd-4a26-9863-2a4be7f46a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3a67cf-1afd-4a26-9863-2a4be7f46a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f9c69f-9cfb-44e2-8ce9-f178f4fbbe66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Volume 865d95ce-0611-4e61-ae8e-d0400e34d3b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3', 'volume_size': 1} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1379738182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865d95ce-0611-4e61-ae8e-d0400e34d3b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e51401d116674e138a06bb09314769db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:07Z,use_quota=True,user_id='a1625e73982e4f31ad62de5d3b1f6911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Creating volume 865d95ce-0611-4e61-ae8e-d0400e34d3b3 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:06 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 1073741824 Nov 02 17:59:06 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:07 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 1073741824" returned: 0 in 0.518s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:07 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 Nov 02 17:59:07 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:07 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2f9c69f-9cfb-44e2-8ce9-f178f4fbbe66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77add753-691c-4995-8902-f1fb1c77aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:07 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Volume volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 (865d95ce-0611-4e61-ae8e-d0400e34d3b3): created successfully Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77add753-691c-4995-8902-f1fb1c77aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Flow 'volume_create_manager' (a2f9af85-dc7d-4f7a-a3a8-218f0ea966e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a56db451-8158-469f-bec9-bba120f45892 tempest-VolumesTransfersV355Test-203463445 None] Created volume successfully. Nov 02 17:59:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Acquiring lock "cinder-865d95ce-0611-4e61-ae8e-d0400e34d3b3-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-865d95ce-0611-4e61-ae8e-d0400e34d3b3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Acquiring lock "cinder-quobyte-865d95ce-0611-4e61-ae8e-d0400e34d3b3" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-quobyte-865d95ce-0611-4e61-ae8e-d0400e34d3b3" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:09 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc80924-620d-496b-b22f-13cd4c2d498b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:09 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 Nov 02 17:59:09 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:10 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3" returned: 0 in 0.606s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:10 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3 Nov 02 17:59:10 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:10 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-865d95ce-0611-4e61-ae8e-d0400e34d3b3" returned: 0 in 0.342s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-quobyte-865d95ce-0611-4e61-ae8e-d0400e34d3b3" released by "delete_volume" :: held 1.027s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Created reservations ['d8c5b2c7-7686-4cfb-98d3-af5f17b21358', '8c89cd77-cb76-4042-bf6e-8b7bde7926c5', '8a7aacc0-90f6-467f-be9b-6d3e4abf0cfd', '3c960534-c70b-4501-8d02-a4095863c63d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:10 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:10 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:11 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.425s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:11 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:11 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Deleted volume successfully. Nov 02 17:59:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ddd13bac-fefd-4129-be59-dca9f7d8e18f tempest-VolumesTransfersV355Test-318209491 None] Lock "cinder-865d95ce-0611-4e61-ae8e-d0400e34d3b3-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:11 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-759b511a-d7a1-4ca1-8d0d-4851ea71b050 req-b7585e11-abe6-4faa-aa92-13c03b986ecd tempest-TestMinimumBasicScenario-2102766644 None] Terminate volume connection completed successfully. Nov 02 17:59:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-759b511a-d7a1-4ca1-8d0d-4851ea71b050 req-b7585e11-abe6-4faa-aa92-13c03b986ecd tempest-TestMinimumBasicScenario-2102766644 None] Deleting attachment 716104d4-fc5d-4744-8dfe-719178ff7b30. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:59:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Acquiring lock "cinder-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Lock "cinder-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Acquiring lock "cinder-quobyte-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Lock "cinder-quobyte-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:12 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[af43fec5-951f-4cfd-abc7-b1014c922a3c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:12 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 Nov 02 17:59:12 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:13 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33" returned: 0 in 0.451s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:13 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33 Nov 02 17:59:13 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:13 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33" returned: 0 in 0.279s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Lock "cinder-quobyte-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33" released by "delete_volume" :: held 0.793s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Created reservations ['3a414037-faaf-42af-a9fd-bdfab268239c', 'ef69df10-5419-4243-92ee-5987ca446bc3', 'c8431383-ad19-4c88-8066-a39bed7f7066', 'b77cd12f-466e-4b9b-801d-98af6d909958'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:13 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:13 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-31f0f831-f5b4-430f-8ebe-d79647555bac tempest-GroupsTest-622442985 None] Group tempest-Group1-2147248657: creating Nov 02 17:59:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-31f0f831-f5b4-430f-8ebe-d79647555bac tempest-GroupsTest-622442985 None] Group tempest-Group1-2147248657: created successfully Nov 02 17:59:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-31f0f831-f5b4-430f-8ebe-d79647555bac tempest-GroupsTest-622442985 None] Create group completed successfully. Nov 02 17:59:13 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.373s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:13 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Deleted volume successfully. Nov 02 17:59:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ba7a13a8-52bc-4513-ade8-c211b8ac2628 tempest-TestMinimumBasicScenario-2102766644 None] Lock "cinder-db6fddfa-bee1-4561-a1eb-d6ec2a91ee33-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b24300b7-ca88-40a2-8a7e-7571f2ea6504 tempest-GroupsTest-622442985 None] Group tempest-Group2-970997434: creating Nov 02 17:59:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b24300b7-ca88-40a2-8a7e-7571f2ea6504 tempest-GroupsTest-622442985 None] Group tempest-Group2-970997434: created successfully Nov 02 17:59:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b24300b7-ca88-40a2-8a7e-7571f2ea6504 tempest-GroupsTest-622442985 None] Create group completed successfully. Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-985f4cfa-0b5e-49e2-8e3f-234afc306398 req-6e8c7a8d-b113-4a85-aa66-0b6750c56a91 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-985f4cfa-0b5e-49e2-8e3f-234afc306398 req-6e8c7a8d-b113-4a85-aa66-0b6750c56a91 tempest-TestStampPattern-201362744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-985f4cfa-0b5e-49e2-8e3f-234afc306398 req-6e8c7a8d-b113-4a85-aa66-0b6750c56a91 tempest-TestStampPattern-201362744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-985f4cfa-0b5e-49e2-8e3f-234afc306398 req-6e8c7a8d-b113-4a85-aa66-0b6750c56a91 tempest-TestStampPattern-201362744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-4d872752-d681-424c-9dae-e604f72992c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7dedca7d-d224-49fc-8ba4-4526d5f7b956', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 17:59:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-985f4cfa-0b5e-49e2-8e3f-234afc306398 req-6e8c7a8d-b113-4a85-aa66-0b6750c56a91 tempest-TestStampPattern-201362744 None] attachment_update completed successfully. Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Flow 'volume_create_manager' (8dda582d-bf5e-40ae-9cae-54d8fa84dae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3c2a97-8a4e-4636-9f58-082f437c006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec3c2a97-8a4e-4636-9f58-082f437c006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-944600121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7670ca7b-aed4-4b57-a102-23b12c9d09d6,host='devstack@QuobyteHD#QuobyteHD',id=bb5fedbd-63cc-4de8-9148-194d4d69f57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a379929b324b08a611e361c23e318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:17Z,use_quota=True,user_id='36b22e81a10c434a98c7f6fa272a551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc4208f3-e303-4249-bc8d-e7d71a96a937),volume_type_id=bc4208f3-e303-4249-bc8d-e7d71a96a937)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc36c9f-9c54-4d68-824b-4e7296ccac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc36c9f-9c54-4d68-824b-4e7296ccac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f97dd28-1750-4724-b048-248f8fc5e0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f97dd28-1750-4724-b048-248f8fc5e0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5fedbd-63cc-4de8-9148-194d4d69f57b', 'volume_name': 'volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5769190d-abe5-4cf1-8791-69cbfd782e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5769190d-abe5-4cf1-8791-69cbfd782e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1897ff68-259e-471a-9bc4-d13d141f9e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Volume bb5fedbd-63cc-4de8-9148-194d4d69f57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b', 'volume_size': 1} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7670ca7b-aed4-4b57-a102-23b12c9d09d6,created_at=2026-11-02T16:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-944600121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7670ca7b-aed4-4b57-a102-23b12c9d09d6,host='devstack@QuobyteHD#QuobyteHD',id=bb5fedbd-63cc-4de8-9148-194d4d69f57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a379929b324b08a611e361c23e318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:17Z,use_quota=True,user_id='36b22e81a10c434a98c7f6fa272a551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc4208f3-e303-4249-bc8d-e7d71a96a937),volume_type_id=bc4208f3-e303-4249-bc8d-e7d71a96a937)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Creating volume bb5fedbd-63cc-4de8-9148-194d4d69f57b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:16 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:17 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b 1073741824 Nov 02 17:59:17 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:17 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b 1073741824" returned: 0 in 0.734s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:17 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b Nov 02 17:59:17 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:17 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b" returned: 0 in 0.278s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1897ff68-259e-471a-9bc4-d13d141f9e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f57895-5158-4808-b560-f1e845ea0419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Volume volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b (bb5fedbd-63cc-4de8-9148-194d4d69f57b): created successfully Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f57895-5158-4808-b560-f1e845ea0419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Flow 'volume_create_manager' (8dda582d-bf5e-40ae-9cae-54d8fa84dae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-74b95343-2b00-492c-a1e5-5896d16222ad tempest-GroupsTest-622442985 None] Created volume successfully. Nov 02 17:59:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Acquiring lock "cinder-quobyte-bb5fedbd-63cc-4de8-9148-194d4d69f57b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Lock "cinder-quobyte-bb5fedbd-63cc-4de8-9148-194d4d69f57b" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:19 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb110ef9-0f4a-4506-9b21-375ff7da94e3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:19 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b Nov 02 17:59:19 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:19 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b" returned: 0 in 0.510s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:19 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b Nov 02 17:59:19 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:20 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-bb5fedbd-63cc-4de8-9148-194d4d69f57b" returned: 0 in 0.334s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Lock "cinder-quobyte-bb5fedbd-63cc-4de8-9148-194d4d69f57b" released by "delete_volume" :: held 0.918s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=155,cinder:SELECT=144,cinder:INSERT=41,cinder:DELETE=8 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Created reservations ['36cefb3b-82a7-43ad-b719-9f2c9cce688b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:20 devstack cinder-volume[86585]: WARNING cinder.quota [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1128138883 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1128138883, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:20 devstack cinder-volume[86585]: WARNING cinder.quota [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1128138883 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1128138883, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Created reservations ['f562e50f-94a9-459e-8c30-9425d98651e1', 'c4f80310-a4a9-455f-aa67-a53fd28cb1f9', '0840196f-4e13-4fa7-9cdf-d901c495fb63', '08c7e1fa-9e33-4967-88f2-f5b0398a8630'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:20 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:20 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Flow 'volume_create_manager' (735fcb06-9429-4ba2-a3ef-d2ce144bb498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67508ed-a183-4225-b754-514a3a13cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b67508ed-a183-4225-b754-514a3a13cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1538039452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a330963-fcef-472c-8ebc-7ce405757555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0746c9313d14c53af63085e8c9adbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:21Z,use_quota=True,user_id='7983d83d8f6746a2935b6e12de1ab4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71523628-7d5d-4f76-a334-3f7234476d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71523628-7d5d-4f76-a334-3f7234476d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbdb4cc-dc7c-468c-b778-895d5a616d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=144,cinder:INSERT=33,cinder:UPDATE=173,cinder:DELETE=9 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:59:20 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.312s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:20 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7430aaea-8692-4106-8a98-c39bab0379ea tempest-GroupsTest-622442985 None] Delete group completed successfully. Nov 02 17:59:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Created reservations ['7dca3f21-2957-47a0-b97a-6a37db03735f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:21 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:21 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbdb4cc-dc7c-468c-b778-895d5a616d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7a330963-fcef-472c-8ebc-7ce405757555', 'volume_name': 'volume-7a330963-fcef-472c-8ebc-7ce405757555', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2827c8c6-5178-4c61-abd7-b8ed11a6eafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2827c8c6-5178-4c61-abd7-b8ed11a6eafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb79699-4618-4c9c-a8a8-25ee334ed487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Volume 7a330963-fcef-472c-8ebc-7ce405757555: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7a330963-fcef-472c-8ebc-7ce405757555', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Trying to clone 7a330963-fcef-472c-8ebc-7ce405757555 from image 789043a6-2392-4529-ac6f-09077d7c12df at location (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 17:59:21 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5bce111b-0c35-43f6-9c67-41e9cb0554de tempest-GroupsTest-622442985 None] Delete group completed successfully. Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 17:59:21 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Image download 20.69 MB at 20.69 MB/s Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2bf4fe-4cc6-45af-a553-b5ab5269f8bd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:21 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD Nov 02 17:59:21 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:22 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df is fetched for user 7983d83d8f6746a2935b6e12de1ab4e3. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eca625-d489-49a7-bef6-c6050fed70e5]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:22 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD Nov 02 17:59:22 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:22 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1538039452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a330963-fcef-472c-8ebc-7ce405757555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0746c9313d14c53af63085e8c9adbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:21Z,use_quota=True,user_id='7983d83d8f6746a2935b6e12de1ab4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Creating volume 7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:22 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e41c03b5-e542-4e2e-be8f-4fb57287eb4f tempest-GroupsTest-622442985 None] Group tempest-GroupsTest-Group-1440779262: creating Nov 02 17:59:22 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 1073741824 Nov 02 17:59:22 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-c7621a9c-3e86-4fd3-b990-b1e450943c7a req-8869b688-236f-409e-bc87-7ee011005dae tempest-TestStampPattern-201362744 None] Terminate volume connection completed successfully. Nov 02 17:59:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-c7621a9c-3e86-4fd3-b990-b1e450943c7a req-8869b688-236f-409e-bc87-7ee011005dae tempest-TestStampPattern-201362744 None] Deleting attachment 7dedca7d-d224-49fc-8ba4-4526d5f7b956. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 17:59:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e41c03b5-e542-4e2e-be8f-4fb57287eb4f tempest-GroupsTest-622442985 None] Group tempest-GroupsTest-Group-1440779262: created successfully Nov 02 17:59:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e41c03b5-e542-4e2e-be8f-4fb57287eb4f tempest-GroupsTest-622442985 None] Create group completed successfully. Nov 02 17:59:23 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 1073741824" returned: 0 in 0.560s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:23 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 Nov 02 17:59:23 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:23 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.055s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Creating offline snapshot 5df8ff9c-5dbe-407f-bf23-c1e48f810166 of volume 4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6b7e6-2649-4000-8c9a-33f4b8572a6f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Attempting download of 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume 7a330963-fcef-472c-8ebc-7ce405757555. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b80c3ad-7361-4238-9ea5-abf54fa14ea9]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:23 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 Nov 02 17:59:23 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:23 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza Nov 02 17:59:23 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:24 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza" returned: 0 in 0.440s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:24 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7" returned: 0 in 0.561s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:24 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 1G Nov 02 17:59:24 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:24 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza Nov 02 17:59:24 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Flow 'volume_create_manager' (db99d957-8957-47c1-b4dd-74e28724c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1a67bb-dae9-46f6-b6ff-c151a19a5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1a67bb-dae9-46f6-b6ff-c151a19a5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-780501279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96bd2418-4fd0-4fac-9bce-2f489afe29fa,host='devstack@QuobyteHD#QuobyteHD',id=2111ea3e-aff5-4d1c-83b7-339d6a99b881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a379929b324b08a611e361c23e318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:24Z,use_quota=True,user_id='36b22e81a10c434a98c7f6fa272a551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279e0716-86fc-4d04-b748-be4ccd7d56e1),volume_type_id=279e0716-86fc-4d04-b748-be4ccd7d56e1)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec29f87-610d-44e6-a82e-71a6d7a2cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec29f87-610d-44e6-a82e-71a6d7a2cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:24 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9dadfc-c65c-4931-bed4-8424ed6e67f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9dadfc-c65c-4931-bed4-8424ed6e67f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2111ea3e-aff5-4d1c-83b7-339d6a99b881', 'volume_name': 'volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d46cbf-e2a5-4972-b043-1f4258a8ee7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d46cbf-e2a5-4972-b043-1f4258a8ee7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e023ad-c6e6-4b51-8304-7d13372d2011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Volume 2111ea3e-aff5-4d1c-83b7-339d6a99b881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881', 'volume_size': 1} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza" returned: 1 in 0.490s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_97psqiza' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c7ea8-d16c-4ee7-9403-4111d50e47ca]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:24 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 1G" returned: 0 in 0.554s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d872752-d681-424c-9dae-e604f72992c7 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:24 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD Nov 02 17:59:24 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:24 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d872752-d681-424c-9dae-e604f72992c7 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 Nov 02 17:59:24 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:25 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] 789043a6-2392-4529-ac6f-09077d7c12df was qcow2, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:25 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 Nov 02 17:59:25 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:25 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d872752-d681-424c-9dae-e604f72992c7 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:25 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 is being set with open permissions: ugo+rw Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:25 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 Nov 02 17:59:25 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:25 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:25 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info Nov 02 17:59:25 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:25 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info" returned: 0 in 0.301s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:25 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info is being set with open permissions: ugo+rw Nov 02 17:59:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:25 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info Nov 02 17:59:25 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:26 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.info" returned: 0 in 0.328s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.461s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=96bd2418-4fd0-4fac-9bce-2f489afe29fa,created_at=2026-11-02T16:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-780501279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96bd2418-4fd0-4fac-9bce-2f489afe29fa,host='devstack@QuobyteHD#QuobyteHD',id=2111ea3e-aff5-4d1c-83b7-339d6a99b881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a379929b324b08a611e361c23e318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:24Z,use_quota=True,user_id='36b22e81a10c434a98c7f6fa272a551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279e0716-86fc-4d04-b748-be4ccd7d56e1),volume_type_id=279e0716-86fc-4d04-b748-be4ccd7d56e1)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Creating volume 2111ea3e-aff5-4d1c-83b7-339d6a99b881 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:26 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:26 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 1073741824 Nov 02 17:59:26 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cfe82201-26e5-49e2-81b5-41b96988b89d tempest-TestStampPattern-201362744 None] Create snapshot completed successfully Nov 02 17:59:26 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 1073741824" returned: 0 in 0.532s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:26 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 Nov 02 17:59:26 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:26 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881" returned: 0 in 0.299s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e023ad-c6e6-4b51-8304-7d13372d2011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5701043-d26c-4bb9-bb6e-51de88abe610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Volume volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 (2111ea3e-aff5-4d1c-83b7-339d6a99b881): created successfully Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5701043-d26c-4bb9-bb6e-51de88abe610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Flow 'volume_create_manager' (db99d957-8957-47c1-b4dd-74e28724c39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8ac3dedb-951c-4374-ad61-cec4cbc92959 tempest-GroupsTest-622442985 None] Created volume successfully. Nov 02 17:59:27 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555" returned: 0 in 2.167s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_6c37sx5ndevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:59:27 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Converted 112.00 MB image at 51.65 MB/s Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:27 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 1G Nov 02 17:59:27 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:27 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 1G" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Downloaded image 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume 7a330963-fcef-472c-8ebc-7ce405757555 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df for user 7983d83d8f6746a2935b6e12de1ab4e3 is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Marking volume 7a330963-fcef-472c-8ebc-7ce405757555 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Copying metadata from image 789043a6-2392-4529-ac6f-09077d7c12df to 7a330963-fcef-472c-8ebc-7ce405757555. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Creating volume glance metadata for volume 7a330963-fcef-472c-8ebc-7ce405757555 backed by image 789043a6-2392-4529-ac6f-09077d7c12df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb79699-4618-4c9c-a8a8-25ee334ed487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a330963-fcef-472c-8ebc-7ce405757555', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb32526-3864-4e39-a206-3a35e3abde7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Volume volume-7a330963-fcef-472c-8ebc-7ce405757555 (7a330963-fcef-472c-8ebc-7ce405757555): created successfully Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eb32526-3864-4e39-a206-3a35e3abde7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Flow 'volume_create_manager' (735fcb06-9429-4ba2-a3ef-d2ce144bb498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-66217c3a-68f5-4270-b574-23bf14039a1c tempest-VolumesExtendTest-1459321027 None] Created volume successfully. Nov 02 17:59:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:28 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f036f4-3a4b-44e6-a036-38a8e447c3e3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:28 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 Nov 02 17:59:28 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:29 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555" returned: 0 in 0.530s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 2G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Flow 'volume_create_manager' (16c1406c-5051-427b-95a7-62b85e8637e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70af0525-ed64-4b0f-8d4a-1f57c648aa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70af0525-ed64-4b0f-8d4a-1f57c648aa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578906267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96bd2418-4fd0-4fac-9bce-2f489afe29fa,host='devstack@QuobyteHD#QuobyteHD',id=2fb4490f-cc5f-4491-b717-7d08541e2313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a379929b324b08a611e361c23e318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:29Z,use_quota=True,user_id='36b22e81a10c434a98c7f6fa272a551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279e0716-86fc-4d04-b748-be4ccd7d56e1),volume_type_id=279e0716-86fc-4d04-b748-be4ccd7d56e1)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f7872e-a2f3-4576-9916-ca3c57776238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f7872e-a2f3-4576-9916-ca3c57776238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d733476-5f61-4ded-bd8e-4cd5018474cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d733476-5f61-4ded-bd8e-4cd5018474cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fb4490f-cc5f-4491-b717-7d08541e2313', 'volume_name': 'volume-2fb4490f-cc5f-4491-b717-7d08541e2313', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65acae2c-7468-426d-95e0-b696c4ee91c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65acae2c-7468-426d-95e0-b696c4ee91c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f77f6f5-06c3-4c27-bf1d-e41027dc4c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Volume 2fb4490f-cc5f-4491-b717-7d08541e2313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fb4490f-cc5f-4491-b717-7d08541e2313', 'volume_size': 1} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 2G" returned: 0 in 0.159s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.742s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=96bd2418-4fd0-4fac-9bce-2f489afe29fa,created_at=2026-11-02T16:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578906267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96bd2418-4fd0-4fac-9bce-2f489afe29fa,host='devstack@QuobyteHD#QuobyteHD',id=2fb4490f-cc5f-4491-b717-7d08541e2313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a379929b324b08a611e361c23e318d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:29Z,use_quota=True,user_id='36b22e81a10c434a98c7f6fa272a551c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(279e0716-86fc-4d04-b748-be4ccd7d56e1),volume_type_id=279e0716-86fc-4d04-b748-be4ccd7d56e1)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Creating volume 2fb4490f-cc5f-4491-b717-7d08541e2313 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:29 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:29 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 1073741824 Nov 02 17:59:29 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-64b3b281-ddec-4876-aec7-2b2ec38830d3 tempest-VolumesExtendTest-1459321027 None] Extend volume completed successfully. Nov 02 17:59:29 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 1073741824" returned: 0 in 0.551s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:29 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 Nov 02 17:59:29 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:30 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-7a330963-fcef-472c-8ebc-7ce405757555-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313" returned: 0 in 0.309s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f77f6f5-06c3-4c27-bf1d-e41027dc4c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fb4490f-cc5f-4491-b717-7d08541e2313', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35703a9-641b-4c83-ba96-0e33acd009c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-7a330963-fcef-472c-8ebc-7ce405757555-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Volume volume-2fb4490f-cc5f-4491-b717-7d08541e2313 (2fb4490f-cc5f-4491-b717-7d08541e2313): created successfully Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c35703a9-641b-4c83-ba96-0e33acd009c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Flow 'volume_create_manager' (16c1406c-5051-427b-95a7-62b85e8637e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-quobyte-7a330963-fcef-472c-8ebc-7ce405757555" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5919b6d8-5d04-4fc9-ab9f-9d8897a0967b tempest-GroupsTest-622442985 None] Created volume successfully. Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-7a330963-fcef-472c-8ebc-7ce405757555" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e641bc1-3b33-41bb-82f2-1ddcfd17e2e4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:30 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 Nov 02 17:59:30 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:30 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555" returned: 0 in 0.424s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:30 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555 Nov 02 17:59:30 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:31 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7a330963-fcef-472c-8ebc-7ce405757555" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-7a330963-fcef-472c-8ebc-7ce405757555" released by "delete_volume" :: held 0.810s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Created reservations ['bf34aee0-c9a1-4e8a-946c-713f9a8201b2', 'bd0e3076-ff1e-4a19-b34b-7aa64c50465e', 'c621e9f3-5e7a-4bab-b993-27065bd13c03', '008f5eb4-8e4e-4fbc-a64c-797662d58c21'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:31 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:31 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:31 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.362s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Deleted volume successfully. Nov 02 17:59:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b1a40b53-ece7-4c9d-8c5f-07f566d03816 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-7a330963-fcef-472c-8ebc-7ce405757555-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-281041a1-468f-4d0b-a0d5-e1e97c0e6eed tempest-GroupsTest-622442985 None] Update group completed successfully. Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Flow 'volume_create_manager' (023036aa-51c1-4329-93d4-2af7cd5f645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84bb4d1-8dca-4e8f-9eb3-081ef22d5c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84bb4d1-8dca-4e8f-9eb3-081ef22d5c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1915356602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf02f20-8ea1-463b-82e2-793c730c2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0746c9313d14c53af63085e8c9adbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:32Z,use_quota=True,user_id='7983d83d8f6746a2935b6e12de1ab4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fd8137-b394-4877-980e-45b5e5bdf120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fd8137-b394-4877-980e-45b5e5bdf120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a014a52-6c7a-4f8e-86c3-3305b415846e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a014a52-6c7a-4f8e-86c3-3305b415846e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acf02f20-8ea1-463b-82e2-793c730c2578', 'volume_name': 'volume-acf02f20-8ea1-463b-82e2-793c730c2578', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69fba6d-57c8-4244-a504-566c1dec1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69fba6d-57c8-4244-a504-566c1dec1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a398d0-10a8-4b97-b012-f8b3feb59ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:32 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Volume acf02f20-8ea1-463b-82e2-793c730c2578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acf02f20-8ea1-463b-82e2-793c730c2578', 'volume_size': 1} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1915356602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf02f20-8ea1-463b-82e2-793c730c2578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0746c9313d14c53af63085e8c9adbcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:32Z,use_quota=True,user_id='7983d83d8f6746a2935b6e12de1ab4e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Creating volume acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:32 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:32 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 1073741824 Nov 02 17:59:32 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:32 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 1073741824" returned: 0 in 0.623s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:32 devstack sudo[101710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 Nov 02 17:59:32 devstack sudo[101710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:33 devstack sudo[101710]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a398d0-10a8-4b97-b012-f8b3feb59ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf02f20-8ea1-463b-82e2-793c730c2578', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d51115-1b7c-447f-a237-1993a4b65f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:33 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Volume volume-acf02f20-8ea1-463b-82e2-793c730c2578 (acf02f20-8ea1-463b-82e2-793c730c2578): created successfully Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d51115-1b7c-447f-a237-1993a4b65f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Flow 'volume_create_manager' (023036aa-51c1-4329-93d4-2af7cd5f645a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9c05d3d2-4167-4d15-bf3a-72b31259c85e tempest-VolumesExtendTest-1459321027 None] Created volume successfully. Nov 02 17:59:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d2d8696c-2040-4513-9cab-f7fda58e6844 tempest-GroupsTest-622442985 None] Update group completed successfully. Nov 02 17:59:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Creating offline snapshot f641e641-6770-44d2-929f-021807b20b44 of volume acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 17:59:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[38001f98-0951-417a-9170-4f95476232fd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:34 devstack sudo[101714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 Nov 02 17:59:34 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:34 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578" returned: 0 in 0.523s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:35 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 1G Nov 02 17:59:35 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Flow 'volume_create_manager' (e70a37f8-3756-4cef-a723-fc7d2b6b33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5865185d-3a8c-47c0-a98e-0855868b3278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5865185d-3a8c-47c0-a98e-0855868b3278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-634170267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbfd21e-8363-41df-955d-034295a35e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd978917aa7342cebb3ff3ee01959f90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5df8ff9c-5dbe-407f-bf23-c1e48f810166,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:35Z,use_quota=True,user_id='737dae73a9bf4cc9b148d4a733779305',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932da5ed-8daa-41fe-a8f9-8eb59d9e781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (932da5ed-8daa-41fe-a8f9-8eb59d9e781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9633286-ec92-4f0b-8ce6-e2279a7ae6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9633286-ec92-4f0b-8ce6-e2279a7ae6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4bbfd21e-8363-41df-955d-034295a35e0e', 'volume_name': 'volume-4bbfd21e-8363-41df-955d-034295a35e0e', 'volume_size': 1, 'snapshot_id': '5df8ff9c-5dbe-407f-bf23-c1e48f810166'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6f7fc2-eedc-48f7-bb92-165132b1ba5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6f7fc2-eedc-48f7-bb92-165132b1ba5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33d78cb-5a73-456f-9ca6-7c661f3fdc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Volume 4bbfd21e-8363-41df-955d-034295a35e0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4bbfd21e-8363-41df-955d-034295a35e0e', 'volume_size': 1, 'snapshot_id': '5df8ff9c-5dbe-407f-bf23-c1e48f810166'} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:35 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 1G" returned: 0 in 0.637s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf02f20-8ea1-463b-82e2-793c730c2578 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:35 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf02f20-8ea1-463b-82e2-793c730c2578 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 Nov 02 17:59:35 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Acquiring lock "cinder-quobyte-2111ea3e-aff5-4d1c-83b7-339d6a99b881" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Lock "cinder-quobyte-2111ea3e-aff5-4d1c-83b7-339d6a99b881" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b81356-47ea-4caa-a21f-c1e9dce3275d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:35 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 Nov 02 17:59:35 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:36 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acf02f20-8ea1-463b-82e2-793c730c2578 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:36 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 is being set with open permissions: ugo+rw Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:36 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 Nov 02 17:59:36 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:36 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881" returned: 0 in 0.539s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:36 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881 Nov 02 17:59:36 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:36 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44" returned: 0 in 0.319s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:36 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info Nov 02 17:59:36 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:36 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2111ea3e-aff5-4d1c-83b7-339d6a99b881" returned: 0 in 0.386s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Lock "cinder-quobyte-2111ea3e-aff5-4d1c-83b7-339d6a99b881" released by "delete_volume" :: held 0.990s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Acquiring lock "cinder-quobyte-2fb4490f-cc5f-4491-b717-7d08541e2313" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Lock "cinder-quobyte-2fb4490f-cc5f-4491-b717-7d08541e2313" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[17299101-d69e-4d0b-bc3c-a5269bae604b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:36 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info" returned: 0 in 0.397s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:36 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info is being set with open permissions: ugo+rw Nov 02 17:59:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:36 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info Nov 02 17:59:36 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:36 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 Nov 02 17:59:36 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:37 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.info" returned: 0 in 0.337s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.809s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-quobyte-5df8ff9c-5dbe-407f-bf23-c1e48f810166-4bbfd21e-8363-41df-955d-034295a35e0e" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-5df8ff9c-5dbe-407f-bf23-c1e48f810166-4bbfd21e-8363-41df-955d-034295a35e0e" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Creating volume 4bbfd21e-8363-41df-955d-034295a35e0e from snapshot 5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-quobyte-4bbfd21e-8363-41df-955d-034295a35e0e" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9f677a88-df31-4c17-ad99-01b07d0ba28e tempest-VolumesExtendTest-1459321027 None] Create snapshot completed successfully Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4bbfd21e-8363-41df-955d-034295a35e0e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] snapshot: 5df8ff9c-5dbe-407f-bf23-c1e48f810166, volume: 4bbfd21e-8363-41df-955d-034295a35e0e, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:37 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313" returned: 0 in 0.540s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[32707b17-066c-402d-bed0-99d9c9ce559d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:37 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313 Nov 02 17:59:37 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:37 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 Nov 02 17:59:37 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:37 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2fb4490f-cc5f-4491-b717-7d08541e2313" returned: 0 in 0.313s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Lock "cinder-quobyte-2fb4490f-cc5f-4491-b717-7d08541e2313" released by "delete_volume" :: held 0.920s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Created reservations ['adf8c288-8425-4ead-9782-46d9e1e0280b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:37 devstack cinder-volume[86585]: WARNING cinder.quota [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1632236813 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1632236813, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:37 devstack cinder-volume[86585]: WARNING cinder.quota [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1632236813 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1632236813, it is now deprecated. Please use the default quota class for default quota. Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:37 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166" returned: 0 in 0.604s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d872752-d681-424c-9dae-e604f72992c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:59:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Created reservations ['07cf5af0-af73-4a16-a933-d15a8d1f458e', 'f33db3b3-47ea-4e1b-89f5-6aa95fd023c2', '8efbf3c4-76fc-4594-afad-2bb23fdec2f8', '13fc178a-ef32-48a9-bd5f-c57c47ebfd2a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e55de3-4830-4c8b-83fb-268dca21834d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:38 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 Nov 02 17:59:38 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Created reservations ['c1311777-98d5-42c4-9687-eafeed99409e', '124cb3b6-3b6b-4bf5-95f7-977b9875086f', '3f57923f-67f1-4116-8272-1cf38adf6f49', 'f6f03b9a-1395-4683-85d4-728c9a823c68'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:38 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:38 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:38 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7" returned: 0 in 0.714s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 17:59:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:38 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e Nov 02 17:59:38 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:38 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.466s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:39 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f606941e-3330-40b6-a833-0fb9f667d9b2 tempest-GroupsTest-622442985 None] Delete group completed successfully. Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:46 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:46 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:47 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.549s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 17:59:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 17:59:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=54,cinder:INSERT=16,cinder:UPDATE=44,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 17:59:48 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e" returned: 0 in 9.761s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7, size 1024.00 MB, duration 9.76 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 17:59:48 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Converted 1024.00 MB image at 104.90 MB/s Nov 02 17:59:48 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e is being set with open permissions: ugo+rw Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:48 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e Nov 02 17:59:48 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:48 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e" returned: 0 in 0.304s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4bbfd21e-8363-41df-955d-034295a35e0e" released by "_copy_volume_from_snapshot" :: held 11.552s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-5df8ff9c-5dbe-407f-bf23-c1e48f810166-4bbfd21e-8363-41df-955d-034295a35e0e" released by "_create_volume_from_snapshot" :: held 11.654s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.689s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 10.960s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b6f14f-b78f-4b8c-8f33-523471fe0db6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33d78cb-5a73-456f-9ca6-7c661f3fdc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbfd21e-8363-41df-955d-034295a35e0e', 'volume_size': 1, 'snapshot_id': '5df8ff9c-5dbe-407f-bf23-c1e48f810166'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69745237-f398-48ca-b687-447362dd211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:48 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Volume volume-4bbfd21e-8363-41df-955d-034295a35e0e (4bbfd21e-8363-41df-955d-034295a35e0e): created successfully Nov 02 17:59:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69745237-f398-48ca-b687-447362dd211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Flow 'volume_create_manager' (e70a37f8-3756-4cef-a723-fc7d2b6b33e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-861c50a6-2e03-4b23-8305-bcd93f932ac6 tempest-TestStampPattern-201362744 None] Created volume successfully. Nov 02 17:59:49 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 Nov 02 17:59:49 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:49 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578" returned: 0 in 0.822s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 2G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 2G" returned: 0 in 0.319s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.212s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:50 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b7bf695f-1819-4953-ab2f-cbfbce00fc37 tempest-VolumesExtendTest-1459321027 None] Extend volume completed successfully. Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-f641e641-6770-44d2-929f-021807b20b44-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-f641e641-6770-44d2-929f-021807b20b44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-quobyte-acf02f20-8ea1-463b-82e2-793c730c2578" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-acf02f20-8ea1-463b-82e2-793c730c2578" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-quobyte-f641e641-6770-44d2-929f-021807b20b44" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-f641e641-6770-44d2-929f-021807b20b44" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Deleting offline snapshot f641e641-6770-44d2-929f-021807b20b44 of volume acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] snapshot_file for this snap is: volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae454d41-5f9e-4784-99c1-55a20ede84d3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:51 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 Nov 02 17:59:51 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:51 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44" returned: 0 in 0.737s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acf02f20-8ea1-463b-82e2-793c730c2578(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0436d-1e56-427b-adcc-1644764ffe93]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:52 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 Nov 02 17:59:52 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:52 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578" returned: 0 in 0.608s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:52 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 Nov 02 17:59:52 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:53 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44" returned: 0 in 0.537s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:53 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44 Nov 02 17:59:53 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:53 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578.f641e641-6770-44d2-929f-021807b20b44" returned: 0 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-f641e641-6770-44d2-929f-021807b20b44" released by "_delete_snapshot" :: held 2.466s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-acf02f20-8ea1-463b-82e2-793c730c2578" released by "delete_snapshot" :: held 2.519s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Created reservations ['bc36f78f-12f2-4b62-b724-e00b1e77b597', '63c3807f-7120-4df9-a143-8ff22e36b62b', '1cf97228-2fc4-414c-ab12-c538b4eabd20', 'e2ca4b22-eb85-451d-bf60-912ad2f22d26'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Delete snapshot completed successfully. Nov 02 17:59:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b176c526-729c-4594-9d25-e287d8892950 tempest-VolumesExtendTest-1459321027 None] Lock "cinder-f641e641-6770-44d2-929f-021807b20b44-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-acf02f20-8ea1-463b-82e2-793c730c2578-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Lock "cinder-acf02f20-8ea1-463b-82e2-793c730c2578-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Acquiring lock "cinder-quobyte-acf02f20-8ea1-463b-82e2-793c730c2578" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 17:59:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-acf02f20-8ea1-463b-82e2-793c730c2578" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 17:59:54 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc4138-aac6-4514-9acf-b84516b0af9d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 17:59:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:54 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 Nov 02 17:59:54 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:55 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578" returned: 0 in 0.552s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:55 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578 Nov 02 17:59:55 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:55 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-acf02f20-8ea1-463b-82e2-793c730c2578" returned: 0 in 0.379s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Lock "cinder-quobyte-acf02f20-8ea1-463b-82e2-793c730c2578" released by "delete_volume" :: held 1.037s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Created reservations ['aeb42143-9064-4ac5-a173-cb5108989234', '469e6155-a731-4b6d-996f-9f95a971a531', '3ba336ef-30a0-48ce-b39e-92a3a1f2f05c', 'c93358ad-24cf-4712-8f5b-d04f76e095c2'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:55 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 17:59:55 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:56 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.416s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:56 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 17:59:56 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Deleted volume successfully. Nov 02 17:59:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b2acc7f0-9d30-4a94-bc7a-2c69b962250f tempest-VolumesExtendTest-1459321027 None] Lock "cinder-acf02f20-8ea1-463b-82e2-793c730c2578-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 17:59:56 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a579b3c4-01bb-4614-8b85-e83e996b787a tempest-GroupsV314Test-752879739 None] Group tempest-GroupsV314Test-Group-877368006: creating Nov 02 17:59:56 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a579b3c4-01bb-4614-8b85-e83e996b787a tempest-GroupsV314Test-752879739 None] Group tempest-GroupsV314Test-Group-877368006: created successfully Nov 02 17:59:56 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a579b3c4-01bb-4614-8b85-e83e996b787a tempest-GroupsV314Test-752879739 None] Create group completed successfully. Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Flow 'volume_create_manager' (06abcf58-3a1d-48b4-8907-9b79fb2396b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2e6aab-f8c5-4d0c-a5fd-c487fdaeb417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2e6aab-f8c5-4d0c-a5fd-c487fdaeb417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T16:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1669062269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83e6f2e4-eb7f-4a6e-bda6-366072bcbd5f,host='devstack@QuobyteHD#QuobyteHD',id=de9bef67-64db-4fcd-a27f-8c000e19fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b066565af82f4f00b49b69e1c0c13059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:59Z,use_quota=True,user_id='d256a8389eb64d40a2b25197fc39bc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a8d6d4a-a46f-43cc-9a22-d383536d9924),volume_type_id=6a8d6d4a-a46f-43cc-9a22-d383536d9924)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e21a5a7-dd53-4889-9f80-069128a303d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e21a5a7-dd53-4889-9f80-069128a303d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0735118b-38da-49b3-9056-cc01dad3cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0735118b-38da-49b3-9056-cc01dad3cad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de9bef67-64db-4fcd-a27f-8c000e19fd1a', 'volume_name': 'volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5b8935-36ce-486f-9d39-ad2afd3ea485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5b8935-36ce-486f-9d39-ad2afd3ea485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50052f4a-13d8-47a9-9d0d-94aa147308d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 17:59:59 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Volume de9bef67-64db-4fcd-a27f-8c000e19fd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a', 'volume_size': 1} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83e6f2e4-eb7f-4a6e-bda6-366072bcbd5f,created_at=2026-11-02T16:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1669062269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83e6f2e4-eb7f-4a6e-bda6-366072bcbd5f,host='devstack@QuobyteHD#QuobyteHD',id=de9bef67-64db-4fcd-a27f-8c000e19fd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b066565af82f4f00b49b69e1c0c13059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T16:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T16:59:59Z,use_quota=True,user_id='d256a8389eb64d40a2b25197fc39bc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a8d6d4a-a46f-43cc-9a22-d383536d9924),volume_type_id=6a8d6d4a-a46f-43cc-9a22-d383536d9924)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Creating volume de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 17:59:59 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:59 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a 1073741824 Nov 02 17:59:59 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 17:59:59 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a 1073741824" returned: 0 in 0.669s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 17:59:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 17:59:59 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a Nov 02 17:59:59 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:00 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a" returned: 0 in 0.430s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50052f4a-13d8-47a9-9d0d-94aa147308d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300cd509-a1c7-4b60-8d78-8800bac2f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Volume volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a (de9bef67-64db-4fcd-a27f-8c000e19fd1a): created successfully Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300cd509-a1c7-4b60-8d78-8800bac2f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Flow 'volume_create_manager' (06abcf58-3a1d-48b4-8907-9b79fb2396b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0cf42cea-55e4-4228-a348-eb48109e79ab tempest-GroupsV314Test-752879739 None] Created volume successfully. Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:03 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Cloning volume de9bef67-64db-4fcd-a27f-8c000e19fd1a to volume d473a1ee-de6c-4dcb-b534-93286f5a6430 Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Creating offline snapshot 10e4c173-00ba-4dc4-882d-f10cd309caef of volume de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25fdf76-a892-4a79-b3f3-2b32b28ba592]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:03 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a Nov 02 18:00:03 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:03 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a" returned: 0 in 0.526s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:03 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef 1G Nov 02 18:00:03 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:04 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef 1G" returned: 0 in 0.664s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:04 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef Nov 02 18:00:04 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (9eb2c858-2b2a-42e9-a3af-5f0850269982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6febbe78-10f5-4589-a558-9e0e2f542dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6febbe78-10f5-4589-a558-9e0e2f542dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-523887037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bb65b9-6319-403f-ab92-e58d059f4d14,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:05Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5796c2-483e-4f94-a8e9-f0901621d890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5796c2-483e-4f94-a8e9-f0901621d890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d35670-c92d-4d26-8a52-d60267cdfdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32d35670-c92d-4d26-8a52-d60267cdfdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1bb65b9-6319-403f-ab92-e58d059f4d14', 'volume_name': 'volume-d1bb65b9-6319-403f-ab92-e58d059f4d14', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811547a-6706-4882-8adb-b0ea3c747c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811547a-6706-4882-8adb-b0ea3c747c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb63c735-ad45-40e8-865d-e531446e28ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Volume d1bb65b9-6319-403f-ab92-e58d059f4d14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1bb65b9-6319-403f-ab92-e58d059f4d14', 'volume_size': 1} Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:04 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef" returned: 0 in 0.338s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:04 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef is being set with open permissions: ugo+rw: NotImplementedError Nov 02 18:00:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:04 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef Nov 02 18:00:04 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:05 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef" returned: 0 in 0.246s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:05 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info Nov 02 18:00:05 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Flow 'volume_create_manager' (d8616da6-1b06-4f2d-9af0-6c639087706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:05 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04dac1a-661b-454c-972d-36ac30e9b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:05 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:05 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04dac1a-661b-454c-972d-36ac30e9b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1770690682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d905940a-bd54-4683-98e8-a728cc996e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52e7757541245e893f9a311777f1fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:05Z,use_quota=True,user_id='538c059e690c442c850442e8a64c024c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:05 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a924ca55-6299-40c2-bf3d-d361abc197b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a924ca55-6299-40c2-bf3d-d361abc197b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defe67a0-54fa-449f-82bd-938bb3a590ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defe67a0-54fa-449f-82bd-938bb3a590ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd905940a-bd54-4683-98e8-a728cc996e4b', 'volume_name': 'volume-d905940a-bd54-4683-98e8-a728cc996e4b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4799363-6707-42fa-b317-1de0cb2ae175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4799363-6707-42fa-b317-1de0cb2ae175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18144554-fad2-4a99-aa0f-988c5ccb66ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Volume d905940a-bd54-4683-98e8-a728cc996e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d905940a-bd54-4683-98e8-a728cc996e4b', 'volume_size': 1} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:05 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.info" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Acquiring lock "cinder-quobyte-d473a1ee-de6c-4dcb-b534-93286f5a6430" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-d473a1ee-de6c-4dcb-b534-93286f5a6430" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] snapshot: 10e4c173-00ba-4dc4-882d-f10cd309caef, volume: d473a1ee-de6c-4dcb-b534-93286f5a6430, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ec61d7-274f-44b8-8cd6-71f68557bd63]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:05 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef Nov 02 18:00:05 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:06 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef" returned: 0 in 0.366s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a7a60-68c2-45f3-b937-358537e1e441]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:06 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a Nov 02 18:00:06 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:06 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a" returned: 0 in 0.345s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:00:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:06 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 Nov 02 18:00:06 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:12 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430" returned: 0 in 6.380s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:12 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:00:12 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Converted 1024.00 MB image at 160.47 MB/s Nov 02 18:00:12 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 18:00:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:12 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 Nov 02 18:00:12 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:13 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-d473a1ee-de6c-4dcb-b534-93286f5a6430" released by "_copy_volume_from_snapshot" :: held 7.403s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Acquiring lock "cinder-quobyte-10e4c173-00ba-4dc4-882d-f10cd309caef" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-10e4c173-00ba-4dc4-882d-f10cd309caef" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Deleting offline snapshot 10e4c173-00ba-4dc4-882d-f10cd309caef of volume de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] snapshot_file for this snap is: volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f242bb9-5c02-4db0-a828-ece9a18a45c4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:13 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef Nov 02 18:00:13 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:13 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7c38db-02e1-49fc-9fc6-ed9b304d1777]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:13 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a Nov 02 18:00:13 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:13 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a" returned: 0 in 0.502s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:13 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef Nov 02 18:00:13 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:14 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:14 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef Nov 02 18:00:14 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:14 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a.10e4c173-00ba-4dc4-882d-f10cd309caef" returned: 0 in 0.246s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-10e4c173-00ba-4dc4-882d-f10cd309caef" released by "_delete_snapshot" :: held 1.530s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.477s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.868s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-523887037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1bb65b9-6319-403f-ab92-e58d059f4d14,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:05Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Creating volume d1bb65b9-6319-403f-ab92-e58d059f4d14 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:00:14 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:00:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:14 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 1073741824 Nov 02 18:00:14 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0a93e250-4a16-4e01-806b-adaa78cb07f3 tempest-GroupsV314Test-752879739 None] Create group from source-group-83e6f2e4-eb7f-4a6e-bda6-366072bcbd5f completed successfully. Nov 02 18:00:15 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 1073741824" returned: 0 in 0.447s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:15 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 Nov 02 18:00:15 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:15 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.985s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1770690682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d905940a-bd54-4683-98e8-a728cc996e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e52e7757541245e893f9a311777f1fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:05Z,use_quota=True,user_id='538c059e690c442c850442e8a64c024c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Creating volume d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:00:15 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb63c735-ad45-40e8-865d-e531446e28ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1bb65b9-6319-403f-ab92-e58d059f4d14', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:15 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b 1073741824 Nov 02 18:00:15 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4c776e-b7ba-42d4-8c35-2f9f68b93e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Volume volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 (d1bb65b9-6319-403f-ab92-e58d059f4d14): created successfully Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4c776e-b7ba-42d4-8c35-2f9f68b93e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (9eb2c858-2b2a-42e9-a3af-5f0850269982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-39e1ebec-8160-4e7f-94c7-279d8c03ce19 tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Acquiring lock "cinder-quobyte-d473a1ee-de6c-4dcb-b534-93286f5a6430" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-d473a1ee-de6c-4dcb-b534-93286f5a6430" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ab2f58-cc51-420f-9997-f92834f79c93]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:15 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 Nov 02 18:00:15 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:15 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b 1073741824" returned: 0 in 0.441s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:15 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b Nov 02 18:00:15 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:16 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430" returned: 0 in 0.442s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:16 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430 Nov 02 18:00:16 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:16 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18144554-fad2-4a99-aa0f-988c5ccb66ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d905940a-bd54-4683-98e8-a728cc996e4b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3948dfe8-6674-418c-8a53-9f556ea7c1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Volume volume-d905940a-bd54-4683-98e8-a728cc996e4b (d905940a-bd54-4683-98e8-a728cc996e4b): created successfully Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3948dfe8-6674-418c-8a53-9f556ea7c1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Flow 'volume_create_manager' (d8616da6-1b06-4f2d-9af0-6c639087706c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c0c55e40-6b8e-4de3-981b-9131fca73c38 tempest-TestImageHashVerification-2033666331 None] Created volume successfully. Nov 02 18:00:16 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d473a1ee-de6c-4dcb-b534-93286f5a6430" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-d473a1ee-de6c-4dcb-b534-93286f5a6430" released by "delete_volume" :: held 0.756s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Created reservations ['ece791ef-08b6-4a7b-80cc-643febbbff41'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:16 devstack cinder-volume[86585]: WARNING cinder.quota [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1262712979 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1262712979, it is now deprecated. Please use the default quota class for default quota. Nov 02 18:00:16 devstack cinder-volume[86585]: WARNING cinder.quota [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1262712979 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1262712979, it is now deprecated. Please use the default quota class for default quota. Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Created reservations ['64d901c4-0412-49dd-92b9-a9f03a358db7', '01e9c31d-ac2a-449e-ad4d-530c111e4190', 'b0146118-7c7d-4428-a0ad-a283fc971219', '3cc7c38c-6880-4e43-9ee2-6ed839b42cbc'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:16 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:16 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:16 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.277s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:16 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-199a16cd-ddb1-4172-be6f-bbec8c9b6e1c tempest-GroupsV314Test-752879739 None] Delete group completed successfully. Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Acquiring lock "cinder-quobyte-de9bef67-64db-4fcd-a27f-8c000e19fd1a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-de9bef67-64db-4fcd-a27f-8c000e19fd1a" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2028b9-e9c4-41b2-b53f-99e81c7c5513]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:17 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a Nov 02 18:00:17 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (ab944dd0-02cc-411a-8ddc-b1f428177b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f59ae8d-6a35-45e6-bec2-6009e3405e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f59ae8d-6a35-45e6-bec2-6009e3405e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1657171936',display_name='tempest-VolumesGetTest-Volume-1800715058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d188ddb-f861-4b3f-9ad7-d0d34ca32535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:17Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa71264-e109-41a9-8278-7da3ba7fda67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa71264-e109-41a9-8278-7da3ba7fda67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3688784-bc38-4eb0-8ea8-109a6332d346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3688784-bc38-4eb0-8ea8-109a6332d346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d188ddb-f861-4b3f-9ad7-d0d34ca32535', 'volume_name': 'volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4830a1-bcf7-4ea5-818d-20ec156e9bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4830a1-bcf7-4ea5-818d-20ec156e9bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f4e24c-53d0-4112-8acb-4de0f0ff63c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:17 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Volume 1d188ddb-f861-4b3f-9ad7-d0d34ca32535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535', 'volume_size': 1} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:17Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1657171936',display_name='tempest-VolumesGetTest-Volume-1800715058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d188ddb-f861-4b3f-9ad7-d0d34ca32535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:17Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Creating volume 1d188ddb-f861-4b3f-9ad7-d0d34ca32535 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:00:17 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:17 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 1073741824 Nov 02 18:00:17 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:17 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a" returned: 0 in 0.544s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:17 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a Nov 02 18:00:17 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:18 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-de9bef67-64db-4fcd-a27f-8c000e19fd1a" returned: 0 in 0.304s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:18 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 1073741824" returned: 0 in 0.509s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Lock "cinder-quobyte-de9bef67-64db-4fcd-a27f-8c000e19fd1a" released by "delete_volume" :: held 0.975s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:18 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 Nov 02 18:00:18 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Created reservations ['670149ba-881c-4d73-982c-b04df4ae3fc5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Created reservations ['fe7ef3d3-f966-491d-a30e-8a7dd0a0d799', 'de6e9e4a-df45-4933-8022-7a1427a67ae4', '83f1f0f0-ee8b-409d-9586-1d39b3615220', 'c6e39cd2-8e9a-4df5-a435-4ec5ce175ecf'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:18 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:18 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:18 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535" returned: 0 in 0.311s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f4e24c-53d0-4112-8acb-4de0f0ff63c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786f1a5d-d374-4107-9f19-dc6cf9829049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Volume volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 (1d188ddb-f861-4b3f-9ad7-d0d34ca32535): created successfully Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (786f1a5d-d374-4107-9f19-dc6cf9829049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (ab944dd0-02cc-411a-8ddc-b1f428177b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d0aeed23-46d9-4395-affa-b1849c688cbe tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4a1cda-ac0f-4896-bfa7-cba491059c21]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:18 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3870554d-59fb-4c14-a61e-95b35c01dde4 tempest-GroupsV314Test-752879739 None] Delete group completed successfully. Nov 02 18:00:18 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b Nov 02 18:00:18 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:18 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b" returned: 0 in 0.373s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc56113-4233-4990-8df6-08c91e2a01e2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:19 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b Nov 02 18:00:19 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:19 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b" returned: 0 in 0.363s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b /opt/stack/data/cinder/conversion/d905940a-bd54-4683-98e8-a728cc996e4b.temp_image.2171f896-3df8-4fb8-8e19-14831c9985f5hkj03nke.img {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:19 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b /opt/stack/data/cinder/conversion/d905940a-bd54-4683-98e8-a728cc996e4b.temp_image.2171f896-3df8-4fb8-8e19-14831c9985f5hkj03nke.img Nov 02 18:00:19 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-1d188ddb-f861-4b3f-9ad7-d0d34ca32535-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Lock "cinder-1d188ddb-f861-4b3f-9ad7-d0d34ca32535-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-1d188ddb-f861-4b3f-9ad7-d0d34ca32535" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-1d188ddb-f861-4b3f-9ad7-d0d34ca32535" acquired by "delete_volume" :: waited 0.048s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4144ac44-e569-4328-8286-08b21fcfc938]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:20 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 Nov 02 18:00:20 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:20 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535" returned: 0 in 0.707s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:20 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535 Nov 02 18:00:20 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:21 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1d188ddb-f861-4b3f-9ad7-d0d34ca32535" returned: 0 in 0.592s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-1d188ddb-f861-4b3f-9ad7-d0d34ca32535" released by "delete_volume" :: held 1.424s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Created reservations ['5faf03f1-61d0-4cdd-890f-6abfd1b79b3c', '22601961-bd2c-4f45-9fe6-d6424acb44c1', '0b4780cf-5b62-41dd-87c1-5fb4dc3362e8', 'f6126983-c567-4184-914f-c48f370d5102'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:21 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:21 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-558a8dea-bbb3-42e2-9ce0-336257222c95 req-e76d5614-2845-4ae0-af9d-ff59159a1633 tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:22 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.764s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-73a478bf-872b-4dbd-9824-2b9dc2ddb87b tempest-VolumesGetTest-1996581578 None] Lock "cinder-1d188ddb-f861-4b3f-9ad7-d0d34ca32535-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-d1bb65b9-6319-403f-ab92-e58d059f4d14-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Lock "cinder-d1bb65b9-6319-403f-ab92-e58d059f4d14-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-d1bb65b9-6319-403f-ab92-e58d059f4d14" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-d1bb65b9-6319-403f-ab92-e58d059f4d14" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb84ebe-b269-454d-9c06-e540dc2e7894]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:22 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 Nov 02 18:00:22 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:23 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14" returned: 0 in 0.684s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:23 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14 Nov 02 18:00:23 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:23 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d1bb65b9-6319-403f-ab92-e58d059f4d14" returned: 0 in 0.398s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-d1bb65b9-6319-403f-ab92-e58d059f4d14" released by "delete_volume" :: held 1.175s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Created reservations ['0d78ffa7-6d24-4cd7-83a9-22e9a1ebc2b0', '45bb6852-b841-4927-8937-8dc3cbc84502', '97f2e65e-032b-4500-8efa-e716e9e4feea', '842414ad-7b1c-4189-837b-44ccf8e47d64'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:24 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:24 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:24 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:24 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:00:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ed6b2e25-1185-4c5a-bd61-db78776625a8 tempest-VolumesGetTest-1996581578 None] Lock "cinder-d1bb65b9-6319-403f-ab92-e58d059f4d14-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (f41c9e3f-7a6f-459d-913f-f5a4cd8fd52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e8ed6e-097b-48b4-bc90-ca629e2231f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e8ed6e-097b-48b4-bc90-ca629e2231f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1416978204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b548a332-7dd0-402d-95ea-6e7684d3bb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:26Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd400628-37ff-4761-bdda-a11714460b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd400628-37ff-4761-bdda-a11714460b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc947b-5e44-4af5-8bbb-bc18c95dc58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cdc947b-5e44-4af5-8bbb-bc18c95dc58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'volume_name': 'volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258012c5-84df-4350-add9-f3c8e09e201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258012c5-84df-4350-add9-f3c8e09e201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb48523f-01f1-4e67-b146-2b0769f08a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Volume b548a332-7dd0-402d-95ea-6e7684d3bb1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'volume_size': 1} Nov 02 18:00:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:27 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b /opt/stack/data/cinder/conversion/d905940a-bd54-4683-98e8-a728cc996e4b.temp_image.2171f896-3df8-4fb8-8e19-14831c9985f5hkj03nke.img" returned: 0 in 8.270s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2ed154-4604-402e-abbe-2b2bbd6f42c0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:27 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b Nov 02 18:00:27 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:28 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b" returned: 0 in 0.542s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b, size 1024.00 MB, duration 8.27 sec, destination /opt/stack/data/cinder/conversion/d905940a-bd54-4683-98e8-a728cc996e4b.temp_image.2171f896-3df8-4fb8-8e19-14831c9985f5hkj03nke.img {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:00:28 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Converted 1024.00 MB image at 123.81 MB/s Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] 2171f896-3df8-4fb8-8e19-14831c9985f5 was raw, no need to convert to raw {{(pid=86585) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Flow 'volume_create_manager' (bb287fbf-d9e3-454b-9e98-cb5f279a59a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db8080d-1e16-49b8-af39-73c61decbbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db8080d-1e16-49b8-af39-73c61decbbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-188155610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4623ea1a-500e-4598-b411-056e75a65043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be00e52ff3fb4c63bbfd4d87e87bc79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:28Z,use_quota=True,user_id='d820bf6842fd422a98306c1abf9204b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e696e6-d5ab-4511-ae0c-5875370be502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e696e6-d5ab-4511-ae0c-5875370be502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb610e81-c300-43a6-9591-84cba4252bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb610e81-c300-43a6-9591-84cba4252bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4623ea1a-500e-4598-b411-056e75a65043', 'volume_name': 'volume-4623ea1a-500e-4598-b411-056e75a65043', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163e19ca-04df-42c3-8f8d-63d3d8da83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (163e19ca-04df-42c3-8f8d-63d3d8da83b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de8ab59-22e8-48cd-b36c-3494ba8f3793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Volume 4623ea1a-500e-4598-b411-056e75a65043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4623ea1a-500e-4598-b411-056e75a65043', 'volume_size': 1} Nov 02 18:00:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:38 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=62,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:00:38 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=73,cinder:SELECT=61,cinder:INSERT=17,cinder:DELETE=4 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:46 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:46 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:46 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:00:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.827s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Uploaded volume to glance image-id: 2171f896-3df8-4fb8-8e19-14831c9985f5. {{(pid=86585) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-558a8dea-bbb3-42e2-9ce0-336257222c95 req-e76d5614-2845-4ae0-af9d-ff59159a1633 tempest-TestStampPattern-201362744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.281s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-558a8dea-bbb3-42e2-9ce0-336257222c95 req-e76d5614-2845-4ae0-af9d-ff59159a1633 tempest-TestStampPattern-201362744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.554s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1416978204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b548a332-7dd0-402d-95ea-6e7684d3bb1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:26Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Creating volume b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:00:47 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2602c820-1c6b-4c41-86dc-012e8787fee0 tempest-TestImageHashVerification-2033666331 None] Copy volume to image completed successfully. Nov 02 18:00:47 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a 1073741824 Nov 02 18:00:47 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-558a8dea-bbb3-42e2-9ce0-336257222c95 req-e76d5614-2845-4ae0-af9d-ff59159a1633 tempest-TestStampPattern-201362744 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-4bbfd21e-8363-41df-955d-034295a35e0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fad45505-9af6-4651-b61e-402a8e106ddb', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 18:00:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-558a8dea-bbb3-42e2-9ce0-336257222c95 req-e76d5614-2845-4ae0-af9d-ff59159a1633 tempest-TestStampPattern-201362744 None] attachment_update completed successfully. Nov 02 18:00:47 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a 1073741824" returned: 0 in 0.537s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:48 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a Nov 02 18:00:48 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:48 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a" returned: 0 in 0.331s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.760s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-188155610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4623ea1a-500e-4598-b411-056e75a65043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be00e52ff3fb4c63bbfd4d87e87bc79c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:28Z,use_quota=True,user_id='d820bf6842fd422a98306c1abf9204b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Creating volume 4623ea1a-500e-4598-b411-056e75a65043 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:00:48 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb48523f-01f1-4e67-b146-2b0769f08a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:48 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 1073741824 Nov 02 18:00:48 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47d2ff9-53f9-4e61-a879-fcb79e2aae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Acquiring lock "cinder-d905940a-bd54-4683-98e8-a728cc996e4b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:48 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Volume volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a (b548a332-7dd0-402d-95ea-6e7684d3bb1a): created successfully Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47d2ff9-53f9-4e61-a879-fcb79e2aae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (f41c9e3f-7a6f-459d-913f-f5a4cd8fd52f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Lock "cinder-d905940a-bd54-4683-98e8-a728cc996e4b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:48 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1c6686d3-c620-4cb5-9ca5-fdbbca9a2fcb tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Acquiring lock "cinder-quobyte-d905940a-bd54-4683-98e8-a728cc996e4b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Lock "cinder-quobyte-d905940a-bd54-4683-98e8-a728cc996e4b" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53f993-5e1f-468d-a526-8e1e20ddb671]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:48 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b Nov 02 18:00:48 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:48 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 1073741824" returned: 0 in 0.469s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:48 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 Nov 02 18:00:48 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:48 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b" returned: 0 in 0.392s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:48 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b Nov 02 18:00:48 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:49 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0de8ab59-22e8-48cd-b36c-3494ba8f3793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4623ea1a-500e-4598-b411-056e75a65043', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7164f3-1015-44da-9f0f-e0ba3b5dccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:49 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Volume volume-4623ea1a-500e-4598-b411-056e75a65043 (4623ea1a-500e-4598-b411-056e75a65043): created successfully Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e7164f3-1015-44da-9f0f-e0ba3b5dccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Flow 'volume_create_manager' (bb287fbf-d9e3-454b-9e98-cb5f279a59a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-96b4c0eb-1256-41b6-ae23-8ef5c310ab50 tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Created volume successfully. Nov 02 18:00:49 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d905940a-bd54-4683-98e8-a728cc996e4b" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Lock "cinder-quobyte-d905940a-bd54-4683-98e8-a728cc996e4b" released by "delete_volume" :: held 0.694s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Created reservations ['404b9923-88b8-4b2e-9c0b-e60d43c726df', '313111b5-d235-42fb-b040-972974981173', 'f31d2bcc-6e9f-448e-b601-f07f1e293065', '3d05f4ce-3553-4d99-9968-0279dd601bd1'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:49 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:49 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:49 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Deleted volume successfully. Nov 02 18:00:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a5e3d4fd-2e6e-4b53-9214-ac3ffb276c98 tempest-TestImageHashVerification-2033666331 None] Lock "cinder-d905940a-bd54-4683-98e8-a728cc996e4b-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (7b665de8-0bdd-4384-91b9-1fadbb57741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32aa16f1-243f-4fc8-981f-aeb8457b7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32aa16f1-243f-4fc8-981f-aeb8457b7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1095935765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae4870b-1a83-4f29-aea7-ee4e3cd686ee,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b548a332-7dd0-402d-95ea-6e7684d3bb1a,status='creating',terminated_at=None,updated_at=2026-11-02T17:00:50Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9eb02a-b9fc-4038-8b2e-64a724e3c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9eb02a-b9fc-4038-8b2e-64a724e3c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a8472b-05aa-446a-b056-61cf032ca08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a8472b-05aa-446a-b056-61cf032ca08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2ae4870b-1a83-4f29-aea7-ee4e3cd686ee', 'volume_name': 'volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee', 'volume_size': 1, 'source_volid': 'b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'source_volstatus': 'available'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557ad358-ba72-4de0-8374-b919ce896d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557ad358-ba72-4de0-8374-b919ce896d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0d87be-dc5a-4b7e-9ccc-28af1c8e43ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:00:50 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Volume 2ae4870b-1a83-4f29-aea7-ee4e3cd686ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee', 'volume_size': 1, 'source_volid': 'b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'source_volstatus': 'available'} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:50 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Cloning volume b548a332-7dd0-402d-95ea-6e7684d3bb1a to volume 2ae4870b-1a83-4f29-aea7-ee4e3cd686ee Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Creating offline snapshot 8ed39ffe-a49b-49a6-b3ae-93aea786d323 of volume b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b810fabe-4a34-421b-830c-26ec36b6fa3e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:50 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a Nov 02 18:00:50 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:50 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a" returned: 0 in 0.586s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:50 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 1G Nov 02 18:00:50 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-0e8ac3f5-b12b-42f0-932d-31925e4440fa req-e201a83c-6ba9-4004-9cae-bd95d2197088 tempest-TestStampPattern-201362744 None] Terminate volume connection completed successfully. Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-0e8ac3f5-b12b-42f0-932d-31925e4440fa req-e201a83c-6ba9-4004-9cae-bd95d2197088 tempest-TestStampPattern-201362744 None] Deleting attachment fad45505-9af6-4651-b61e-402a8e106ddb. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Acquiring lock "cinder-4623ea1a-500e-4598-b411-056e75a65043-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "cinder-4623ea1a-500e-4598-b411-056e75a65043-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:51 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 1G" returned: 0 in 0.589s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Acquiring lock "cinder-quobyte-4623ea1a-500e-4598-b411-056e75a65043" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:51 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 Nov 02 18:00:51 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "cinder-quobyte-4623ea1a-500e-4598-b411-056e75a65043" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebfbc7d-6c15-4196-b58d-8038ece9d3ea]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:51 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 Nov 02 18:00:51 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:51 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323" returned: 0 in 0.380s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:51 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 is being set with open permissions: ugo+rw Nov 02 18:00:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:51 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 Nov 02 18:00:51 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:52 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043" returned: 0 in 0.477s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:52 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043 Nov 02 18:00:52 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:52 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323" returned: 0 in 0.327s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:52 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info Nov 02 18:00:52 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:52 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4623ea1a-500e-4598-b411-056e75a65043" returned: 0 in 0.307s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "cinder-quobyte-4623ea1a-500e-4598-b411-056e75a65043" released by "delete_volume" :: held 0.837s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Created reservations ['0ba105c6-90e6-4d47-b392-82efab2924af', '8bf0dd68-e664-429d-9b09-33cb017ea2fc', '1fc92fac-87da-491f-a8c1-0cb9cef47b32', '7adb38a3-07dd-4b75-988d-d0f79c3b7a27'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:52 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info" returned: 0 in 0.396s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:52 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info is being set with open permissions: ugo+rw Nov 02 18:00:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:52 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:00:52 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:52 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info Nov 02 18:00:52 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:53 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.info" returned: 0 in 0.480s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] snapshot: 8ed39ffe-a49b-49a6-b3ae-93aea786d323, volume: 2ae4870b-1a83-4f29-aea7-ee4e3cd686ee, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:00:53 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.668s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:00:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Deleted volume successfully. Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[716c44cb-01ae-4b0b-9aaa-08631d6f482f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2c9f17c9-124e-4bc9-b202-cbcd45c3af9c tempest-VolumeQuotasNegativeTestJSON-1834475327 None] Lock "cinder-4623ea1a-500e-4598-b411-056e75a65043-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:53 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 Nov 02 18:00:53 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:53 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323" returned: 0 in 0.528s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61888f-37d1-4a78-a58d-59f8c3edf114]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:53 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a Nov 02 18:00:53 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:54 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a" returned: 0 in 0.479s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:00:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:00:54 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:00:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:54 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee Nov 02 18:00:54 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-4bbfd21e-8363-41df-955d-034295a35e0e-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Lock "cinder-4bbfd21e-8363-41df-955d-034295a35e0e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-quobyte-4bbfd21e-8363-41df-955d-034295a35e0e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:00:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4bbfd21e-8363-41df-955d-034295a35e0e" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:00:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f32c02-dfd4-43be-bcf0-07450f6336d7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:00:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:58 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e Nov 02 18:00:58 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:59 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e" returned: 0 in 0.973s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:00:59 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e Nov 02 18:00:59 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:00:59 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Nov 02 18:00:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4bbfd21e-8363-41df-955d-034295a35e0e" returned: 0 in 0.498s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:00:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4bbfd21e-8363-41df-955d-034295a35e0e" released by "delete_volume" :: held 1.628s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:00:59 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Created reservations ['8743d3ad-fcb5-4f69-a014-b884d4c76908', 'ef2c71e8-82d5-4f48-977e-53acf0a09b8f', '059c5f74-0995-4299-8643-45d7a8186c68', '0e513ef1-37b4-459d-9d11-c3dde1f26e6c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:00 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:00 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:00 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.603s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Deleted volume successfully. Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-709cd5ad-ec28-423a-a2b1-b455a1ac184f tempest-TestStampPattern-201362744 None] Lock "cinder-4bbfd21e-8363-41df-955d-034295a35e0e-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-5df8ff9c-5dbe-407f-bf23-c1e48f810166-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Lock "cinder-5df8ff9c-5dbe-407f-bf23-c1e48f810166-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-quobyte-4d872752-d681-424c-9dae-e604f72992c7" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4d872752-d681-424c-9dae-e604f72992c7" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-quobyte-5df8ff9c-5dbe-407f-bf23-c1e48f810166" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-5df8ff9c-5dbe-407f-bf23-c1e48f810166" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Deleting offline snapshot 5df8ff9c-5dbe-407f-bf23-c1e48f810166 of volume 4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] snapshot_file for this snap is: volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf19ef0a-6f5b-4eeb-a501-e6a57df80450]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:01 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 Nov 02 18:01:01 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:02 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166" returned: 0 in 0.837s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d872752-d681-424c-9dae-e604f72992c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:02 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f49a5b2-9a10-42e6-9c76-304dba454bab]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:02 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 Nov 02 18:01:02 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:03 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7" returned: 0 in 1.133s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:03 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 Nov 02 18:01:03 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:03 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166" returned: 0 in 0.748s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:04 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" returned: 0 in 9.722s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a, size 1024.00 MB, duration 9.72 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:01:04 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Converted 1024.00 MB image at 105.31 MB/s Nov 02 18:01:04 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee is being set with open permissions: ugo+rw Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:04 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166 Nov 02 18:01:04 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:04 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee Nov 02 18:01:04 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:04 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7.5df8ff9c-5dbe-407f-bf23-c1e48f810166" returned: 0 in 0.279s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-5df8ff9c-5dbe-407f-bf23-c1e48f810166" released by "_delete_snapshot" :: held 3.247s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:04 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4d872752-d681-424c-9dae-e604f72992c7" released by "delete_snapshot" :: held 3.299s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" returned: 0 in 0.313s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" released by "_copy_volume_from_snapshot" :: held 11.204s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-8ed39ffe-a49b-49a6-b3ae-93aea786d323" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-8ed39ffe-a49b-49a6-b3ae-93aea786d323" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Deleting offline snapshot 8ed39ffe-a49b-49a6-b3ae-93aea786d323 of volume b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] snapshot_file for this snap is: volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2008c100-81ca-41bb-8634-b1d717d98be0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Created reservations ['5d707607-f7d1-436a-94c6-32b1ff41f67d', '28f36719-3a06-43c0-88f8-5a4c5c5dbdea', 'd4164dba-f148-46f0-a33d-e20a921ce56d', 'bd9bd16c-45dd-45d5-8b96-47e0c8064bfd'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:04 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Delete snapshot completed successfully. Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d1a101b2-4499-4586-911a-360eedc11fd8 tempest-TestStampPattern-201362744 None] Lock "cinder-5df8ff9c-5dbe-407f-bf23-c1e48f810166-delete_snapshot" released by "delete_snapshot" :: held 3.610s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:04 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 Nov 02 18:01:04 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:04 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323" returned: 0 in 0.450s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2470b42-8317-4025-9f7f-036d3a20c6f7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:05 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a Nov 02 18:01:05 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:05 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a" returned: 0 in 0.612s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:05 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 Nov 02 18:01:05 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Flow 'volume_create_manager' (7bda6819-4ed0-4992-8bae-e4323d0cd953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0a3d67-715d-47d8-9005-6443070e87e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0a3d67-715d-47d8-9005-6443070e87e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1616685190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270381a8-cdf2-47ac-8c47-46374df6c026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32027f97904b4fcea07980931919f821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:06Z,use_quota=True,user_id='33d7d8a1e263428d9947145995deca24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(340a9b9f-d604-40a7-b5f4-e97b4faf365a),volume_type_id=340a9b9f-d604-40a7-b5f4-e97b4faf365a)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5c4ef9-ee5b-4247-b885-d21fc8f706db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5c4ef9-ee5b-4247-b885-d21fc8f706db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:06 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0a46db-d14e-48b3-a4b3-219b82347f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef0a46db-d14e-48b3-a4b3-219b82347f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '270381a8-cdf2-47ac-8c47-46374df6c026', 'volume_name': 'volume-270381a8-cdf2-47ac-8c47-46374df6c026', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca33c93-df5d-424c-9f17-7cf646a53bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca33c93-df5d-424c-9f17-7cf646a53bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fc7e03-cc53-4646-9a1b-1d9aa38cc051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Volume 270381a8-cdf2-47ac-8c47-46374df6c026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-270381a8-cdf2-47ac-8c47-46374df6c026', 'volume_size': 1} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323" returned: 0 in 0.572s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:06 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323 Nov 02 18:01:06 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:06 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a.8ed39ffe-a49b-49a6-b3ae-93aea786d323" returned: 0 in 0.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-8ed39ffe-a49b-49a6-b3ae-93aea786d323" released by "_delete_snapshot" :: held 2.050s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.311s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1616685190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=270381a8-cdf2-47ac-8c47-46374df6c026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32027f97904b4fcea07980931919f821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:06Z,use_quota=True,user_id='33d7d8a1e263428d9947145995deca24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(340a9b9f-d604-40a7-b5f4-e97b4faf365a),volume_type_id=340a9b9f-d604-40a7-b5f4-e97b4faf365a)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Creating volume 270381a8-cdf2-47ac-8c47-46374df6c026 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d0d87be-dc5a-4b7e-9ccc-28af1c8e43ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee', 'volume_size': 1, 'source_volid': 'b548a332-7dd0-402d-95ea-6e7684d3bb1a', 'source_volstatus': 'available'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:06 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 1073741824 Nov 02 18:01:06 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4d814c-af94-4d6b-b535-4621c06965a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Volume volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee (2ae4870b-1a83-4f29-aea7-ee4e3cd686ee): created successfully Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4d814c-af94-4d6b-b535-4621c06965a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (7b665de8-0bdd-4384-91b9-1fadbb57741c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-80f765d3-5d40-4043-a977-435043b620d2 tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:01:07 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 1073741824" returned: 0 in 0.837s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:07 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 Nov 02 18:01:07 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:07 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026" returned: 0 in 0.516s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fc7e03-cc53-4646-9a1b-1d9aa38cc051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-270381a8-cdf2-47ac-8c47-46374df6c026', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0af57e-3ba8-4eea-aaf5-091c7facf43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Volume volume-270381a8-cdf2-47ac-8c47-46374df6c026 (270381a8-cdf2-47ac-8c47-46374df6c026): created successfully Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0af57e-3ba8-4eea-aaf5-091c7facf43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Flow 'volume_create_manager' (7bda6819-4ed0-4992-8bae-e4323d0cd953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2ebf36d7-f11d-4ef0-8952-f48e31d56c9b tempest-VolumeTypesAccessTest-266106220 None] Created volume successfully. Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (75d384e1-1773-4770-94a0-88a96e09d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895607af-42b2-44d5-8790-27f492d11e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (895607af-42b2-44d5-8790-27f492d11e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2027260421',display_name='tempest-VolumesGetTest-Volume-1382680034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c4782a-66e2-4030-acae-8dd89864bb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:08Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec1f66c-ff81-4f3e-b21b-1097866f81d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec1f66c-ff81-4f3e-b21b-1097866f81d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7028394b-78bf-48d6-b2ad-dc605d2c3bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7028394b-78bf-48d6-b2ad-dc605d2c3bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c4782a-66e2-4030-acae-8dd89864bb81', 'volume_name': 'volume-52c4782a-66e2-4030-acae-8dd89864bb81', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2edbda3-7aa5-4015-91b7-31406708ebed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2edbda3-7aa5-4015-91b7-31406708ebed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168a4c33-42c9-45dc-a280-1363e071e1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Volume 52c4782a-66e2-4030-acae-8dd89864bb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c4782a-66e2-4030-acae-8dd89864bb81', 'volume_size': 1} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2027260421',display_name='tempest-VolumesGetTest-Volume-1382680034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c4782a-66e2-4030-acae-8dd89864bb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:08Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Creating volume 52c4782a-66e2-4030-acae-8dd89864bb81 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:08 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:08 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 1073741824 Nov 02 18:01:08 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:08 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 1073741824" returned: 0 in 0.704s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:09 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 Nov 02 18:01:09 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Acquiring lock "cinder-270381a8-cdf2-47ac-8c47-46374df6c026-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Lock "cinder-270381a8-cdf2-47ac-8c47-46374df6c026-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:09 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81" returned: 0 in 0.369s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168a4c33-42c9-45dc-a280-1363e071e1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c4782a-66e2-4030-acae-8dd89864bb81', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfa2a30-c859-4a01-a5e0-9390aecdaf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Acquiring lock "cinder-quobyte-270381a8-cdf2-47ac-8c47-46374df6c026" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:09 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Volume volume-52c4782a-66e2-4030-acae-8dd89864bb81 (52c4782a-66e2-4030-acae-8dd89864bb81): created successfully Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abfa2a30-c859-4a01-a5e0-9390aecdaf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (75d384e1-1773-4770-94a0-88a96e09d10d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Lock "cinder-quobyte-270381a8-cdf2-47ac-8c47-46374df6c026" acquired by "delete_volume" :: waited 0.053s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:09 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-936ddd5c-3502-466e-be74-42e46bee0632 tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105619b-00cd-4005-92b7-a719aab689cb]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:09 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 Nov 02 18:01:09 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:09 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026" returned: 0 in 0.406s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:09 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026 Nov 02 18:01:09 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-4d872752-d681-424c-9dae-e604f72992c7-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Lock "cinder-4d872752-d681-424c-9dae-e604f72992c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Acquiring lock "cinder-quobyte-4d872752-d681-424c-9dae-e604f72992c7" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4d872752-d681-424c-9dae-e604f72992c7" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:10 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-270381a8-cdf2-47ac-8c47-46374df6c026" returned: 0 in 0.341s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7d2187-f55f-4121-8f5e-fbfaa92684f7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Lock "cinder-quobyte-270381a8-cdf2-47ac-8c47-46374df6c026" released by "delete_volume" :: held 0.810s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:10 devstack cinder-volume[86585]: WARNING cinder.quota [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2012958074 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2012958074, it is now deprecated. Please use the default quota class for default quota. Nov 02 18:01:10 devstack cinder-volume[86585]: WARNING cinder.quota [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2012958074 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2012958074, it is now deprecated. Please use the default quota class for default quota. Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Created reservations ['7546aaed-4ea4-462b-bd39-6a7dfe1dc036', '4b9e0260-0173-4631-8fb6-31fe452b147c', '4378c230-08cb-4fa8-9f53-e7b13f37cf2c', '18e142b2-6cc6-48ad-8b1b-b3abc36c05e6'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:10 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 Nov 02 18:01:10 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:10 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:10 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-52c4782a-66e2-4030-acae-8dd89864bb81-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Lock "cinder-52c4782a-66e2-4030-acae-8dd89864bb81-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-52c4782a-66e2-4030-acae-8dd89864bb81" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-52c4782a-66e2-4030-acae-8dd89864bb81" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de7dc1c-5871-4a50-afef-b00685eb7343]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:10 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 Nov 02 18:01:10 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:10 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7" returned: 0 in 0.580s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:10 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7 Nov 02 18:01:10 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:10 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.444s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Deleted volume successfully. Nov 02 18:01:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ea0582ed-6f38-4f1b-b09d-0bee47c1ebc0 tempest-VolumeTypesAccessTest-266106220 None] Lock "cinder-270381a8-cdf2-47ac-8c47-46374df6c026-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:11 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81" returned: 0 in 0.508s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:11 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81 Nov 02 18:01:11 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:11 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4d872752-d681-424c-9dae-e604f72992c7" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Lock "cinder-quobyte-4d872752-d681-424c-9dae-e604f72992c7" released by "delete_volume" :: held 1.073s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Created reservations ['3b17102b-15db-4401-8f0e-71d3552c8600', 'c229eec2-a003-4a25-98df-616c8f76c4de', '39bc2c78-6f48-47d3-ad26-01f2e703acee', '221e0c87-d668-4403-8e05-586cbe9d4e76'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:11 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:11 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:11 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-52c4782a-66e2-4030-acae-8dd89864bb81" returned: 0 in 0.328s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-52c4782a-66e2-4030-acae-8dd89864bb81" released by "delete_volume" :: held 0.904s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Created reservations ['bd048481-84a8-4abe-817f-087337a45924', '50595eed-5cef-401d-8ec4-3956461b50d0', '8dd0a056-818d-4a3d-ac32-e7edde144b2c', '9b536365-5be5-4694-9e21-8bf82f001802'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:11 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:11 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:11 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.337s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:11 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Deleted volume successfully. Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9acb3d7b-64c1-4979-8697-7356b25dee2a tempest-TestStampPattern-201362744 None] Lock "cinder-4d872752-d681-424c-9dae-e604f72992c7-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Lock "cinder-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a450d-a450-490d-8bc8-0baaa8964321]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:12 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f005818f-7b0c-4a21-b58b-c756aab443c5 tempest-VolumesGetTest-1996581578 None] Lock "cinder-52c4782a-66e2-4030-acae-8dd89864bb81-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:12 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee Nov 02 18:01:12 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (b618b0b6-a369-4496-a7a9-cfe5852075b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c20670-ee1f-40ce-9564-79ea9f13e99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c20670-ee1f-40ce-9564-79ea9f13e99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129179712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:12Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e77168-18be-4ba9-8c8f-2d653b4a9f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42e77168-18be-4ba9-8c8f-2d653b4a9f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ada5e37-5ba0-488d-a539-a60f522e1c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ada5e37-5ba0-488d-a539-a60f522e1c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b', 'volume_name': 'volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c0d04b-18a2-43c3-91a0-d5d9d4b62e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c0d04b-18a2-43c3-91a0-d5d9d4b62e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c8f83-dad2-4e39-a72b-101219fff3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:12 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b', 'volume_size': 1} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129179712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:12Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating volume c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:12 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:12 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" returned: 0 in 0.530s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:12 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b 1073741824 Nov 02 18:01:12 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:12 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee Nov 02 18:01:12 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:12 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee" released by "delete_volume" :: held 0.886s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:12 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Created reservations ['55f3c62b-c0e0-4f12-8546-53cd364e7058', '448b1d6d-2a6c-4e11-808f-3690a72e464a', 'ff12a20d-27d6-4152-bc65-866b7c93a446', '5e66d005-b9ea-4d96-929c-a04988f9d2d9'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:13 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:13 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:13 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b 1073741824" returned: 0 in 0.665s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:13 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b Nov 02 18:01:13 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:13 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dc448649-5ac1-4bc2-996d-9e9501646129 tempest-VolumesGetTest-1996581578 None] Lock "cinder-2ae4870b-1a83-4f29-aea7-ee4e3cd686ee-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:13 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" returned: 0 in 0.333s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89c8f83-dad2-4e39-a72b-101219fff3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fad035-87c3-405c-b6e8-0a3bd132b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b (c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b): created successfully Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6fad035-87c3-405c-b6e8-0a3bd132b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (b618b0b6-a369-4496-a7a9-cfe5852075b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4bfabd5e-fac0-4dde-aaca-367223cf3dfa tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created volume successfully. Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-b548a332-7dd0-402d-95ea-6e7684d3bb1a-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Lock "cinder-b548a332-7dd0-402d-95ea-6e7684d3bb1a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-b548a332-7dd0-402d-95ea-6e7684d3bb1a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-b548a332-7dd0-402d-95ea-6e7684d3bb1a" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7bc2fa-cfe1-4e02-acf2-f2bcb8846981]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:14 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a Nov 02 18:01:14 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating offline snapshot 8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c of volume c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9504db-ca37-4d96-b330-8bb552dffc6a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:14 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a" returned: 0 in 0.489s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:14 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a Nov 02 18:01:14 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:14 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b Nov 02 18:01:14 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:15 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b548a332-7dd0-402d-95ea-6e7684d3bb1a" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-b548a332-7dd0-402d-95ea-6e7684d3bb1a" released by "delete_volume" :: held 0.922s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Created reservations ['8852992d-479c-4b51-9c95-2d5c6bf6476a', 'c629f00a-8717-4026-bc7f-24234ebff7ac', 'e4e54a4b-f141-4970-8c3b-d39379d996d6', 'c28a9ce1-0204-4dc9-81d6-36b907ce4da3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:15 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:15 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:15 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" returned: 0 in 0.710s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:15 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c 1G Nov 02 18:01:15 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:15 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.331s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:01:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8912b0f-528d-40dd-8bf5-902c9b4da52b tempest-VolumesGetTest-1996581578 None] Lock "cinder-b548a332-7dd0-402d-95ea-6e7684d3bb1a-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:16 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c 1G" returned: 0 in 0.636s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:16 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c Nov 02 18:01:16 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:16 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" returned: 0 in 0.339s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:16 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c is being set with open permissions: ugo+rw Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:16 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c Nov 02 18:01:16 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (8e2e0530-c67c-4dc8-94e2-9d1f86bce36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7307857-6d6f-450e-87c8-1dc0890058cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7307857-6d6f-450e-87c8-1dc0890058cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-513419422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07be301c-1fe7-4d5f-97a6-2e49a851fda0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:17Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868269e3-31c1-4dbb-982f-5e20bfa3f75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868269e3-31c1-4dbb-982f-5e20bfa3f75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34e55e2-90eb-4ae8-ba0d-70e37b129698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 18:01:16 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" returned: 0 in 0.322s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:16 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info Nov 02 18:01:16 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:17 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info" returned: 0 in 0.312s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:17 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info is being set with open permissions: ugo+rw Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34e55e2-90eb-4ae8-ba0d-70e37b129698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07be301c-1fe7-4d5f-97a6-2e49a851fda0', 'volume_name': 'volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41aa81c-56f4-45d1-b6db-c5d7e3ba372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:17 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info Nov 02 18:01:17 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41aa81c-56f4-45d1-b6db-c5d7e3ba372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed09d6a-9b03-4674-9a8e-389c91b9ac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:17 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Volume 07be301c-1fe7-4d5f-97a6-2e49a851fda0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Trying to clone 07be301c-1fe7-4d5f-97a6-2e49a851fda0 from image 789043a6-2392-4529-ac6f-09077d7c12df at location (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 18:01:17 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.info" returned: 0 in 0.307s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.762s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-85ddbc1e-d507-46bc-8a28-a35f736fe89a tempest-CreateVolumesFromSnapshotTest-1940402819 None] Create snapshot completed successfully Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 18:01:17 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Image download 20.69 MB at 20.69 MB/s Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea4e9c6-f5cc-4649-88a9-53f00282adf7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:17 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD Nov 02 18:01:17 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:18 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df is fetched for user 7683d69437f84716bacd076f4a4ca48d. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a14a0-79ba-4f0c-99c4-7218d47c8aba]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:18 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD Nov 02 18:01:18 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:18 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-513419422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07be301c-1fe7-4d5f-97a6-2e49a851fda0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:17Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Creating volume 07be301c-1fe7-4d5f-97a6-2e49a851fda0 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:18 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:18 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 1073741824 Nov 02 18:01:18 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (7c772629-4eb3-492f-9024-2b04541ffc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6132449a-3894-4daf-a54d-83042cb2936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6132449a-3894-4daf-a54d-83042cb2936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1066034825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadba078-3dd4-4daa-b6d8-fed73d066016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:19Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1095b436-69be-48b1-a205-451b02a3488d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1095b436-69be-48b1-a205-451b02a3488d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a8333a-2fde-4bef-84da-044ab11efe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a8333a-2fde-4bef-84da-044ab11efe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadba078-3dd4-4daa-b6d8-fed73d066016', 'volume_name': 'volume-eadba078-3dd4-4daa-b6d8-fed73d066016', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c915040-aeea-4e57-a99c-af6b9ea2b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c915040-aeea-4e57-a99c-af6b9ea2b39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb5da3a-e25e-40f9-ac79-96729d55c7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume eadba078-3dd4-4daa-b6d8-fed73d066016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadba078-3dd4-4daa-b6d8-fed73d066016', 'volume_size': 1} Nov 02 18:01:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (f849f558-0f3d-46bb-a562-81d2c059e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2553ea10-f46d-41db-b0ce-abd5429e388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2553ea10-f46d-41db-b0ce-abd5429e388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1520175067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9e315e-4991-4fad-b4a0-49a29ec7e182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:19Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d16ad1-cd96-43d7-b81d-27beb4bef187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4d16ad1-cd96-43d7-b81d-27beb4bef187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6111ead-f4e8-46ae-86b5-72adbe25f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6111ead-f4e8-46ae-86b5-72adbe25f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9e315e-4991-4fad-b4a0-49a29ec7e182', 'volume_name': 'volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca8c16d-4b6d-4f8a-a267-daec9844257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca8c16d-4b6d-4f8a-a267-daec9844257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0529fb7d-374d-495f-9696-a0a0154e7d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:19 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume ff9e315e-4991-4fad-b4a0-49a29ec7e182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182', 'volume_size': 1} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:19 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 1073741824" returned: 0 in 0.862s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:19 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 Nov 02 18:01:19 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (a6d109e3-7afc-4f84-899c-140a05c78467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b11b63-1e61-460f-adde-f1d0cfda23d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24b11b63-1e61-460f-adde-f1d0cfda23d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441346715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b81ec8-34cd-44e2-9aaa-178d084dd4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:20Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1f6354-5d76-48c4-9dc1-8fa42f8f18a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1f6354-5d76-48c4-9dc1-8fa42f8f18a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbe4fbe-fc3a-4d54-9ed8-096daeb1c319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbe4fbe-fc3a-4d54-9ed8-096daeb1c319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b81ec8-34cd-44e2-9aaa-178d084dd4d8', 'volume_name': 'volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ecd65d-33cf-445b-9bc9-d270201c4c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73ecd65d-33cf-445b-9bc9-d270201c4c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bdb6dd-38d7-45c0-821b-1eb2328eb8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume f3b81ec8-34cd-44e2-9aaa-178d084dd4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8', 'volume_size': 1} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1066034825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadba078-3dd4-4daa-b6d8-fed73d066016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:19Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating volume eadba078-3dd4-4daa-b6d8-fed73d066016 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:20 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:20 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 1073741824 Nov 02 18:01:20 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Attempting download of 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume 07be301c-1fe7-4d5f-97a6-2e49a851fda0. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c179f-2a4e-4e14-b343-ed67aeca7f12]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:20 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk Nov 02 18:01:20 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:20 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (716d63f6-fa7b-4a12-90a2-ca27d680f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d49ecfd-5e31-495e-8088-a01b27fcab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 1073741824" returned: 0 in 0.649s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d49ecfd-5e31-495e-8088-a01b27fcab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862592618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb407502-384d-4e8e-93ff-28bae91024c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:21Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1009c3a3-2ed4-476e-8a63-17c2e5c2b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1009c3a3-2ed4-476e-8a63-17c2e5c2b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f894be-4bb6-4c0c-ac18-e59cb1f0260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1f894be-4bb6-4c0c-ac18-e59cb1f0260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb407502-384d-4e8e-93ff-28bae91024c0', 'volume_name': 'volume-cb407502-384d-4e8e-93ff-28bae91024c0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9976534-9ebe-4cb6-8b8e-e0d3b893e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9976534-9ebe-4cb6-8b8e-e0d3b893e79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32d11b-7e13-47e8-95f8-1abb5c402f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:20 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume cb407502-384d-4e8e-93ff-28bae91024c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb407502-384d-4e8e-93ff-28bae91024c0', 'volume_size': 1} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:20 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk" returned: 0 in 0.659s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:20 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 Nov 02 18:01:20 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (1b777b49-08b9-4591-bba4-1eff1eb1594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e9e672-18d4-4b17-99c1-c96bacae4c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e9e672-18d4-4b17-99c1-c96bacae4c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026119785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9b1264-f3d8-4822-a818-ec2c198b536d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:21Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fe680b-fd9d-4712-9201-19f9ef9c1269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fe680b-fd9d-4712-9201-19f9ef9c1269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6603f0-81e9-4a4d-a0cc-bcd55e9136c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6603f0-81e9-4a4d-a0cc-bcd55e9136c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a9b1264-f3d8-4822-a818-ec2c198b536d', 'volume_name': 'volume-4a9b1264-f3d8-4822-a818-ec2c198b536d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86328ccf-102d-4e3b-810e-34e22b72ffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86328ccf-102d-4e3b-810e-34e22b72ffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca4786-4527-4fc5-bd7c-5eb0f78fab76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume 4a9b1264-f3d8-4822-a818-ec2c198b536d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a9b1264-f3d8-4822-a818-ec2c198b536d', 'volume_size': 1} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:21 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk Nov 02 18:01:21 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:21 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016" returned: 0 in 0.393s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1520175067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9e315e-4991-4fad-b4a0-49a29ec7e182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:19Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating volume ff9e315e-4991-4fad-b4a0-49a29ec7e182 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:21 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb5da3a-e25e-40f9-ac79-96729d55c7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadba078-3dd4-4daa-b6d8-fed73d066016', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c981342-3eaa-429b-911e-1275b3b83c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:21 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 1073741824 Nov 02 18:01:21 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume volume-eadba078-3dd4-4daa-b6d8-fed73d066016 (eadba078-3dd4-4daa-b6d8-fed73d066016): created successfully Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c981342-3eaa-429b-911e-1275b3b83c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (7c772629-4eb3-492f-9024-2b04541ffc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c1e99ab9-2206-48ca-9d0f-4ecb602751d4 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created volume successfully. Nov 02 18:01:21 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk" returned: 1 in 0.608s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_789043a6-2392-4529-ac6f-09077d7c12df_o8ow2zjk' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef9e22-1069-42b2-865d-9d9c8726a13d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:21 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD Nov 02 18:01:21 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:21 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 1073741824" returned: 0 in 0.639s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:21 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] 789043a6-2392-4529-ac6f-09077d7c12df was qcow2, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 18:01:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:22 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 Nov 02 18:01:22 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:22 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 Nov 02 18:01:22 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:22 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182" returned: 0 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.333s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-441346715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b81ec8-34cd-44e2-9aaa-178d084dd4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:20Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating volume f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:22 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0529fb7d-374d-495f-9696-a0a0154e7d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:22 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 1073741824 Nov 02 18:01:22 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d95068-027d-4aa9-a706-e1835cbd3058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:22 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 (ff9e315e-4991-4fad-b4a0-49a29ec7e182): created successfully Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7d95068-027d-4aa9-a706-e1835cbd3058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (f849f558-0f3d-46bb-a562-81d2c059e83a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e2f1dd4e-76d9-47c2-b1e6-611c34cb2fa7 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created volume successfully. Nov 02 18:01:23 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 1073741824" returned: 0 in 0.718s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:23 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 Nov 02 18:01:23 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:23 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8" returned: 0 in 0.315s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.682s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862592618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb407502-384d-4e8e-93ff-28bae91024c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:21Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating volume cb407502-384d-4e8e-93ff-28bae91024c0 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:23 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:23 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 1073741824 Nov 02 18:01:23 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bdb6dd-38d7-45c0-821b-1eb2328eb8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec06e24-f890-47fb-902f-df954882c08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:23 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 (f3b81ec8-34cd-44e2-9aaa-178d084dd4d8): created successfully Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec06e24-f890-47fb-902f-df954882c08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (a6d109e3-7afc-4f84-899c-140a05c78467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0e524918-e6f0-4b07-9d90-0d9f3c510d61 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created volume successfully. Nov 02 18:01:24 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 1073741824" returned: 0 in 0.578s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:24 devstack sudo[103079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 Nov 02 18:01:24 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:24 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0" returned: 0 in 2.536s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_789043a6-2392-4529-ac6f-09077d7c12df_s6b5fspodevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:01:24 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Converted 112.00 MB image at 44.13 MB/s Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:24 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 1G Nov 02 18:01:24 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:24 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0" returned: 0 in 0.436s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.478s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026119785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9b1264-f3d8-4822-a818-ec2c198b536d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1752206a7748499aa7d646ccf8f7eba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:21Z,use_quota=True,user_id='4cfa1205517f41da99a0596a3669af47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Creating volume 4a9b1264-f3d8-4822-a818-ec2c198b536d {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:24 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:24 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d 1073741824 Nov 02 18:01:24 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Flow 'volume_create_manager' (65a2abd3-be62-46d3-8980-f6f95a03d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd657fa-a39d-4f48-8aee-3f0d51e36105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b32d11b-7e13-47e8-95f8-1abb5c402f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb407502-384d-4e8e-93ff-28bae91024c0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda7cc97-1f34-4297-ac8a-a47f2dc559b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd657fa-a39d-4f48-8aee-3f0d51e36105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-229790495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842f28c8-a507-43f6-9fe6-85c74e91e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8839815908124dc1a2628200a0190324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:25Z,use_quota=True,user_id='97592258dd3f4277a759992a7c53ad1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbe2fd0-8db4-41c5-982b-f3f28a7a251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adbe2fd0-8db4-41c5-982b-f3f28a7a251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad07dbd-b853-4dea-a5de-3806ef6ef60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad07dbd-b853-4dea-a5de-3806ef6ef60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842f28c8-a507-43f6-9fe6-85c74e91e048', 'volume_name': 'volume-842f28c8-a507-43f6-9fe6-85c74e91e048', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b1c6bb-ca8e-4819-8d38-afc5252dc41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4b1c6bb-ca8e-4819-8d38-afc5252dc41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501a18bb-e733-4cf2-aa8d-09cc8824554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Volume 842f28c8-a507-43f6-9fe6-85c74e91e048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842f28c8-a507-43f6-9fe6-85c74e91e048', 'volume_size': 1} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume volume-cb407502-384d-4e8e-93ff-28bae91024c0 (cb407502-384d-4e8e-93ff-28bae91024c0): created successfully Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda7cc97-1f34-4297-ac8a-a47f2dc559b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (716d63f6-fa7b-4a12-90a2-ca27d680f282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bd75f5fc-2d64-4bfa-953d-ff5b629911d2 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created volume successfully. Nov 02 18:01:24 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 1G" returned: 0 in 0.372s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Downloaded image 789043a6-2392-4529-ac6f-09077d7c12df ((None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}])) to volume 07be301c-1fe7-4d5f-97a6-2e49a851fda0 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Temporary image 789043a6-2392-4529-ac6f-09077d7c12df for user 7683d69437f84716bacd076f4a4ca48d is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Marking volume 07be301c-1fe7-4d5f-97a6-2e49a851fda0 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Copying metadata from image 789043a6-2392-4529-ac6f-09077d7c12df to 07be301c-1fe7-4d5f-97a6-2e49a851fda0. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Creating volume glance metadata for volume 07be301c-1fe7-4d5f-97a6-2e49a851fda0 backed by image 789043a6-2392-4529-ac6f-09077d7c12df with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed09d6a-9b03-4674-9a8e-389c91b9ac2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0', 'volume_size': 1, 'image_id': '789043a6-2392-4529-ac6f-09077d7c12df', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/789043a6-2392-4529-ac6f-09077d7c12df', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8851a1dfb4c341a5a43f2dd3b3ee7166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '789043a6-2392-4529-ac6f-09077d7c12df', 'created_at': datetime.datetime(2026, 11, 2, 16, 41, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 16, 41, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/789043a6-2392-4529-ac6f-09077d7c12df/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8a074e-2bcb-45ec-bc35-68e04415a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Volume volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 (07be301c-1fe7-4d5f-97a6-2e49a851fda0): created successfully Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8a074e-2bcb-45ec-bc35-68e04415a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (8e2e0530-c67c-4dc8-94e2-9d1f86bce36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7668adbf-8663-45f6-9a12-f0dbeb1bb35d tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:01:25 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d 1073741824" returned: 0 in 0.519s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:25 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d Nov 02 18:01:25 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:25 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d" returned: 0 in 0.339s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-229790495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842f28c8-a507-43f6-9fe6-85c74e91e048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8839815908124dc1a2628200a0190324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:25Z,use_quota=True,user_id='97592258dd3f4277a759992a7c53ad1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Creating volume 842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:25 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ca4786-4527-4fc5-bd7c-5eb0f78fab76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9b1264-f3d8-4822-a818-ec2c198b536d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:25 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 1073741824 Nov 02 18:01:25 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fdd721-f1ab-489d-96c7-b123930464a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Volume volume-4a9b1264-f3d8-4822-a818-ec2c198b536d (4a9b1264-f3d8-4822-a818-ec2c198b536d): created successfully Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16fdd721-f1ab-489d-96c7-b123930464a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Flow 'volume_create_manager' (1b777b49-08b9-4591-bba4-1eff1eb1594b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2cf4777d-0947-42a8-9b1b-9c7b85b3857b tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created volume successfully. Nov 02 18:01:26 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 1073741824" returned: 0 in 0.541s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:26 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 Nov 02 18:01:26 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (1baab3af-2ca4-42d6-ad46-e4e7681baed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930aeff0-886b-4b89-87bc-c11b96885b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930aeff0-886b-4b89-87bc-c11b96885b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-732660717',display_name='tempest-VolumesGetTest-Volume-1855012096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:26Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713b1c0-1ce3-47b3-9261-636db74e0a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713b1c0-1ce3-47b3-9261-636db74e0a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b26ff3-9368-4c5a-a894-fb4ce9621cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b26ff3-9368-4c5a-a894-fb4ce9621cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258', 'volume_name': 'volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d0c77b-e19c-45a0-b692-11051f73c01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d0c77b-e19c-45a0-b692-11051f73c01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc34432c-c837-43c3-b6cc-37e2a5b69344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:26 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Volume 8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258', 'volume_size': 1} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:26 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.094s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-732660717',display_name='tempest-VolumesGetTest-Volume-1855012096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b153675c0044c9da0d51813fdcbd0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:26Z,use_quota=True,user_id='7683d69437f84716bacd076f4a4ca48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Creating volume 8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:26 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (501a18bb-e733-4cf2-aa8d-09cc8824554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842f28c8-a507-43f6-9fe6-85c74e91e048', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:26 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 1073741824 Nov 02 18:01:26 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45aeb306-40a5-4e93-bbb2-cdceea7eaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:26 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Volume volume-842f28c8-a507-43f6-9fe6-85c74e91e048 (842f28c8-a507-43f6-9fe6-85c74e91e048): created successfully Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45aeb306-40a5-4e93-bbb2-cdceea7eaee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Flow 'volume_create_manager' (65a2abd3-be62-46d3-8980-f6f95a03d283) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-47b37dbf-0c6d-437f-85dd-f6fade93d3b6 tempest-SnapshotMetadataTestJSON-1683834177 None] Created volume successfully. Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-4a9b1264-f3d8-4822-a818-ec2c198b536d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-4a9b1264-f3d8-4822-a818-ec2c198b536d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-4a9b1264-f3d8-4822-a818-ec2c198b536d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-4a9b1264-f3d8-4822-a818-ec2c198b536d" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8ff3d-f1eb-4242-b59e-c341db41e1bd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:26 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 1073741824" returned: 0 in 0.583s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:27 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d Nov 02 18:01:27 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:27 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 Nov 02 18:01:27 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:27 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258" returned: 0 in 0.307s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.409s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Creating offline snapshot eed56db9-b38b-4592-829c-bd4aed8960a9 of volume 842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:01:27 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc34432c-c837-43c3-b6cc-37e2a5b69344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bf1c70-91f6-4727-abf0-26ce4ec09027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d" returned: 0 in 0.480s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bed8ac-4eb5-4ddc-b9a2-c180ba436c0f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:27 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d Nov 02 18:01:27 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Volume volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 (8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258): created successfully Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bf1c70-91f6-4727-abf0-26ce4ec09027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Flow 'volume_create_manager' (1baab3af-2ca4-42d6-ad46-e4e7681baed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-83145630-6fde-44c3-a975-3eb76e76d3d7 tempest-VolumesGetTest-1996581578 None] Created volume successfully. Nov 02 18:01:27 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 Nov 02 18:01:27 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:27 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4a9b1264-f3d8-4822-a818-ec2c198b536d" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-4a9b1264-f3d8-4822-a818-ec2c198b536d" released by "delete_volume" :: held 0.799s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['fbbee676-93f7-4000-a8eb-1a74d2c4841e', 'edd9798a-6a80-44f7-bb98-0e673bcc410a', 'a22d9b52-913b-408f-b1b4-80260a79bc9a', '540235c5-b116-46f1-a5d1-e2a754157bf5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:27 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:27 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:27 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:27 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 1G Nov 02 18:01:27 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-cb407502-384d-4e8e-93ff-28bae91024c0-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-cb407502-384d-4e8e-93ff-28bae91024c0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-cb407502-384d-4e8e-93ff-28bae91024c0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-cb407502-384d-4e8e-93ff-28bae91024c0" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:28 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.427s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleted volume successfully. Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[52178781-b28c-422c-b4ab-b914a7882af6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-351839cd-8ab4-4188-87c2-8490d06589f3 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-4a9b1264-f3d8-4822-a818-ec2c198b536d-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:28 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 Nov 02 18:01:28 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:28 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 1G" returned: 0 in 0.677s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-842f28c8-a507-43f6-9fe6-85c74e91e048 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Lock "cinder-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:28 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-842f28c8-a507-43f6-9fe6-85c74e91e048 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 Nov 02 18:01:28 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ddf636-ce95-4a6c-abdb-bf0ac68c9b69]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:28 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0" returned: 0 in 0.491s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:28 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 Nov 02 18:01:28 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:28 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0 Nov 02 18:01:28 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:28 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-842f28c8-a507-43f6-9fe6-85c74e91e048 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9" returned: 0 in 0.395s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:28 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 is being set with open permissions: ugo+rw Nov 02 18:01:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:28 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 Nov 02 18:01:28 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cb407502-384d-4e8e-93ff-28bae91024c0" returned: 0 in 0.303s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-cb407502-384d-4e8e-93ff-28bae91024c0" released by "delete_volume" :: held 0.866s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:29 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258" returned: 0 in 0.455s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:29 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258 Nov 02 18:01:29 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['10384301-f222-4be4-ae8b-729266901c2b', '681b42c3-4675-485a-a207-82d0febe92eb', 'd38580da-32cd-4b8e-bf13-8d54ea643952', 'ea9809a1-ae5a-4e9e-b018-4e0546c94c32'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:29 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9" returned: 0 in 0.310s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:29 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:29 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:29 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info Nov 02 18:01:29 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:29 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258" returned: 0 in 0.395s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258" released by "delete_volume" :: held 0.934s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f4e5da-5ba3-4fcc-9e0c-8cd3db44aa5f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:29 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info" returned: 0 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info is being set with open permissions: ugo+rw Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Created reservations ['30728472-d83f-4e70-848b-063c6047798a', '75ce4f7c-4a7f-4021-80dd-3bd8fd004fc4', '23997ac5-4670-45ad-92bc-ae9fb5c97eb2', '8aafaddd-7b73-4503-8180-b039a853c34b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:29 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.417s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:29 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info Nov 02 18:01:29 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleted volume successfully. Nov 02 18:01:29 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 Nov 02 18:01:29 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-18da1d5b-b4ce-46c3-9e14-0991369200b8 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-cb407502-384d-4e8e-93ff-28bae91024c0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:29 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:29 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:29 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.info" returned: 0 in 0.313s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:30 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8" returned: 0 in 0.468s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-fe6ddb11-a84f-4b4c-aeb2-11aafd4c56d8 tempest-SnapshotMetadataTestJSON-1683834177 None] Create snapshot completed successfully Nov 02 18:01:30 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8 Nov 02 18:01:30 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:30 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a45a584f-3cd5-406d-9e7e-febb581df1bf tempest-VolumesGetTest-1996581578 None] Lock "cinder-8ce4f4c4-af36-4749-8ae0-4ad8d7b6c258-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:30 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8" returned: 0 in 0.252s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8" released by "delete_volume" :: held 0.787s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['65af9139-0750-46b6-b152-452bcebf2214', 'f3228ba0-46a2-494c-b8ec-533a2b7a2faf', '69b955d4-1aeb-456d-92eb-4c32689490c8', '12f8d301-7b62-4f9f-88b7-5ada14cbbab8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:30 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:30 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-ff9e315e-4991-4fad-b4a0-49a29ec7e182-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-ff9e315e-4991-4fad-b4a0-49a29ec7e182-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-ff9e315e-4991-4fad-b4a0-49a29ec7e182" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-ff9e315e-4991-4fad-b4a0-49a29ec7e182" acquired by "delete_volume" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:30 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.311s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleted volume successfully. Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b77e88-1470-4195-b2e5-09f8af6a21a3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1de05290-0287-4cb9-a14d-33eff7f4a63d tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-f3b81ec8-34cd-44e2-9aaa-178d084dd4d8-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-07be301c-1fe7-4d5f-97a6-2e49a851fda0-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Lock "cinder-07be301c-1fe7-4d5f-97a6-2e49a851fda0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:30 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 Nov 02 18:01:30 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Acquiring lock "cinder-quobyte-07be301c-1fe7-4d5f-97a6-2e49a851fda0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-07be301c-1fe7-4d5f-97a6-2e49a851fda0" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdeeb4a-14a5-425a-9669-d543ddc36573]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:31 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 Nov 02 18:01:31 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:31 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182" returned: 0 in 0.429s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:31 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182 Nov 02 18:01:31 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:31 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0" returned: 0 in 0.477s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:31 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff9e315e-4991-4fad-b4a0-49a29ec7e182" returned: 0 in 0.290s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:31 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0 Nov 02 18:01:31 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-ff9e315e-4991-4fad-b4a0-49a29ec7e182" released by "delete_volume" :: held 0.786s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['91b428f1-94dd-412d-ba7d-e88bb6b43cec', '193c8b8f-c1b5-4fe5-911d-9f2f828e21b9', 'c2ee33fa-9b7d-45dc-89d3-5fef3e2306e7', '2803117f-e257-44d4-bd09-3efd88b3715f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:31 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:31 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:31 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-07be301c-1fe7-4d5f-97a6-2e49a851fda0" returned: 0 in 0.357s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Lock "cinder-quobyte-07be301c-1fe7-4d5f-97a6-2e49a851fda0" released by "delete_volume" :: held 0.902s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-eadba078-3dd4-4daa-b6d8-fed73d066016-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-eadba078-3dd4-4daa-b6d8-fed73d066016-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:31 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-eadba078-3dd4-4daa-b6d8-fed73d066016" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Created reservations ['3921ed88-3fcd-465e-9854-3402ad2854eb', '129623f4-7377-4004-a7c6-34801f4cbf0c', 'd11ff389-7ba0-412c-8959-e869fbbb85eb', '84319c10-db80-44f9-8912-08d9a9c44b1b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.301s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleted volume successfully. Nov 02 18:01:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-eadba078-3dd4-4daa-b6d8-fed73d066016" acquired by "delete_volume" :: waited 0.051s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4c5bfcca-f780-438a-8949-c98c18d0dfe5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-ff9e315e-4991-4fad-b4a0-49a29ec7e182-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ae811b-a4c1-4eb8-8ed3-26740c6aaa48]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:32 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:32 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "cinder-eed56db9-b38b-4592-829c-bd4aed8960a9-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-eed56db9-b38b-4592-829c-bd4aed8960a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "cinder-quobyte-842f28c8-a507-43f6-9fe6-85c74e91e048" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-quobyte-842f28c8-a507-43f6-9fe6-85c74e91e048" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "cinder-quobyte-eed56db9-b38b-4592-829c-bd4aed8960a9" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-quobyte-eed56db9-b38b-4592-829c-bd4aed8960a9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:32 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Deleting offline snapshot eed56db9-b38b-4592-829c-bd4aed8960a9 of volume 842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:32 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] snapshot_file for this snap is: volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[610da3e1-f9f4-4d33-841c-6c7afca1bfad]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:32 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 Nov 02 18:01:32 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:32 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.294s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Deleted volume successfully. Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9266d27c-d02f-4c4a-891f-8215928f7aaf tempest-VolumesGetTest-1996581578 None] Lock "cinder-07be301c-1fe7-4d5f-97a6-2e49a851fda0-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:32 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016" returned: 0 in 0.480s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:32 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016 Nov 02 18:01:32 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:32 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9" returned: 0 in 0.402s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-842f28c8-a507-43f6-9fe6-85c74e91e048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3bd0ab-41b4-473f-82d1-12fec3d87619]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:32 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-eadba078-3dd4-4daa-b6d8-fed73d066016" returned: 0 in 0.277s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-eadba078-3dd4-4daa-b6d8-fed73d066016" released by "delete_volume" :: held 0.839s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:32 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 Nov 02 18:01:32 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['6e40b7b6-df62-4b18-9638-be3393364d31', '5898ff0d-e280-43d6-9f63-f3a16d709472', '2853968d-5dd0-4fad-832b-aa65ec5888ba', '3ec18016-b43b-44f9-b642-a7babc359292'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:32 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:32 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:33 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleting offline snapshot 8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c of volume c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] snapshot_file for this snap is: volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048" returned: 0 in 0.507s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e3a68f-f47d-43f9-a93c-b668936c4adb]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:33 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 Nov 02 18:01:33 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:33 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.366s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleted volume successfully. Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ad7e6ae-4141-4a33-bc52-16bd399086df tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-eadba078-3dd4-4daa-b6d8-fed73d066016-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:33 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c Nov 02 18:01:33 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Flow 'volume_create_manager' (66b4b6ba-bd22-4481-ab43-5e8cffc13309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c9cac7-4d83-4e75-8e36-bda68302df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0c9cac7-4d83-4e75-8e36-bda68302df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a71a3c-aa22-4333-b679-af2e9cfcc627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c544c88806ad451f9ec102298ec6a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:34Z,use_quota=True,user_id='c1d537bf6f1c47eab74e85a1e403d9c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3419e98f-460a-46d9-ba6c-b30b78b50093),volume_type_id=3419e98f-460a-46d9-ba6c-b30b78b50093)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01f2e96-bc42-4276-81f4-a22f71a1b643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a01f2e96-bc42-4276-81f4-a22f71a1b643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387bf8d1-89a3-4734-a3b2-c030b5542469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 18:01:33 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:33 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" returned: 0 in 0.416s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:33 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9 Nov 02 18:01:33 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c39260f-2214-44d6-9809-0b95d4dbebd0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:33 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b Nov 02 18:01:33 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:33 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048.eed56db9-b38b-4592-829c-bd4aed8960a9" returned: 0 in 0.302s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-quobyte-eed56db9-b38b-4592-829c-bd4aed8960a9" released by "_delete_snapshot" :: held 1.806s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-quobyte-842f28c8-a507-43f6-9fe6-85c74e91e048" released by "delete_snapshot" :: held 1.842s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Created reservations ['f0ff719a-6560-4da9-b987-6ad0a78a93bc', 'fa6a7923-0a1a-4c79-9981-2000e754ca5d', 'd5a5a3fb-c55f-4aa4-9490-23bb4a1dfa1a', '7085f564-1d95-487d-8426-72901a2532f4'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387bf8d1-89a3-4734-a3b2-c030b5542469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b7a71a3c-aa22-4333-b679-af2e9cfcc627', 'volume_name': 'volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627', 'volume_size': 1, 'image_id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1786ad67-8357-4f6d-8187-c1b982d71165', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1dfb369df43a4e5ac49d76f564bd1dec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c544c88806ad451f9ec102298ec6a610', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '110771e4ee39bf2dcab4f1f79551636ea2db967b3750bae24fdb35f2aea4c47356ba65e2a0304faf800ebbf6efd06c97b653cd57f4c272df729787f788cd53f2', 'id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'created_at': datetime.datetime(2026, 11, 2, 17, 1, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1786ad67-8357-4f6d-8187-c1b982d71165/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:34 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a7935-7e77-40f1-b8bb-7fce79c4a780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a7935-7e77-40f1-b8bb-7fce79c4a780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a0412a-efe6-4623-8344-758820ff706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Volume b7a71a3c-aa22-4333-b679-af2e9cfcc627: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627', 'volume_size': 1, 'image_id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1786ad67-8357-4f6d-8187-c1b982d71165', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1dfb369df43a4e5ac49d76f564bd1dec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c544c88806ad451f9ec102298ec6a610', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '110771e4ee39bf2dcab4f1f79551636ea2db967b3750bae24fdb35f2aea4c47356ba65e2a0304faf800ebbf6efd06c97b653cd57f4c272df729787f788cd53f2', 'id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'created_at': datetime.datetime(2026, 11, 2, 17, 1, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1786ad67-8357-4f6d-8187-c1b982d71165/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Trying to clone b7a71a3c-aa22-4333-b679-af2e9cfcc627 from image 1786ad67-8357-4f6d-8187-c1b982d71165 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1786ad67-8357-4f6d-8187-c1b982d71165', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" returned: 0 in 0.525s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Delete snapshot completed successfully. Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-95280c01-0361-41e9-bd56-39915b4b3b9e tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-eed56db9-b38b-4592-829c-bd4aed8960a9-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:34 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c Nov 02 18:01:34 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 18:01:34 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Image download 0.00 MB at 0.00 MB/s Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "cinder-842f28c8-a507-43f6-9fe6-85c74e91e048-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc67f58-c319-4c2d-9d7b-4f767012923a]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-842f28c8-a507-43f6-9fe6-85c74e91e048-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "cinder-quobyte-842f28c8-a507-43f6-9fe6-85c74e91e048" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-quobyte-842f28c8-a507-43f6-9fe6-85c74e91e048" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[096570fc-60d1-4d1d-b4a9-011a22807339]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:34 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD Nov 02 18:01:34 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:34 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 Nov 02 18:01:34 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:34 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" returned: 0 in 0.528s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:34 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c Nov 02 18:01:34 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:34 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD" returned: 0 in 0.454s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:35 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD Nov 02 18:01:35 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:35 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048" returned: 0 in 0.444s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:35 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b.8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" returned: 0 in 0.325s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:35 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048 Nov 02 18:01:35 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c" released by "_delete_snapshot" :: held 1.984s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" released by "delete_snapshot" :: held 2.046s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['4a583fe5-4b02-4099-bd3d-83db4b41b75f', '73d1b1a0-1672-4f3c-9319-23e87eefb103', '834899de-7bfb-4ed8-8b85-8c612edcd7e0', '70d46aa9-0648-4648-a141-1d286dbefbcd'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Delete snapshot completed successfully. Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8305cbdf-3e7e-4206-81f4-e661e3993ca5 tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-8fb8cdeb-c7f0-4bc9-8e1e-a0820bc92c5c-delete_snapshot" released by "delete_snapshot" :: held 2.228s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:35 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD" returned: 1 in 0.434s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Temporary image 1786ad67-8357-4f6d-8187-c1b982d71165 is fetched for user c1d537bf6f1c47eab74e85a1e403d9c7. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 18:01:35 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-842f28c8-a507-43f6-9fe6-85c74e91e048" returned: 0 in 0.346s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-quobyte-842f28c8-a507-43f6-9fe6-85c74e91e048" released by "delete_volume" :: held 0.872s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[62138c4f-24ee-45e3-a1f0-a78ae1022d2f]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Created reservations ['83daae94-f2f9-4ec0-b200-ac36190d2c21', '0b63f182-d495-42c9-8c71-9ebe4055c864', 'd2de52ee-d61a-405e-98f2-d13d38904c69', '2ab3622d-6512-4ee0-a87c-0eacd78351e3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:35 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD Nov 02 18:01:35 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:35 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:35 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:35 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:35 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.301s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:35 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Deleted volume successfully. Nov 02 18:01:35 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD Nov 02 18:01:35 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bd9e0f60-5d8d-4428-8dad-6564067a2bb2 tempest-SnapshotMetadataTestJSON-1683834177 None] Lock "cinder-842f28c8-a507-43f6-9fe6-85c74e91e048-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:36 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD" returned: 1 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7a71a3c-aa22-4333-b679-af2e9cfcc627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c544c88806ad451f9ec102298ec6a610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:34Z,use_quota=True,user_id='c1d537bf6f1c47eab74e85a1e403d9c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3419e98f-460a-46d9-ba6c-b30b78b50093),volume_type_id=3419e98f-460a-46d9-ba6c-b30b78b50093)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Creating volume b7a71a3c-aa22-4333-b679-af2e9cfcc627 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:36 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:36 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 1073741824 Nov 02 18:01:36 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "cinder-quobyte-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e19cad-bec9-4a53-9aad-5939d998b02b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:36 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b Nov 02 18:01:36 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:36 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 1073741824" returned: 0 in 0.605s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:36 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 Nov 02 18:01:36 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:37 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" returned: 0 in 0.473s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:37 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b Nov 02 18:01:37 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:37 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627" returned: 0 in 0.333s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Attempting download of 1786ad67-8357-4f6d-8187-c1b982d71165 ((None, [{'url': 'file:///opt/stack/data/glance/images/1786ad67-8357-4f6d-8187-c1b982d71165', 'metadata': {}}])) to volume b7a71a3c-aa22-4333-b679-af2e9cfcc627. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd84e1-75ff-4d56-841c-6385c441c3b5]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:37 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-quobyte-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b" released by "delete_volume" :: held 0.866s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Created reservations ['ad19db5f-3065-4514-a237-23924453d492', 'a2ab936c-4fea-4ba5-8cd7-14d294c0375b', '6d5ac632-475a-4cef-8b29-f368374628d2', 'ff3da156-0ff3-4a83-af74-a43732fe3a1f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:37 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk Nov 02 18:01:37 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:37 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:37 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:37 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk" returned: 0 in 0.441s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:37 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.425s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:37 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:37 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk Nov 02 18:01:37 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Deleted volume successfully. Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6adafcfe-f49e-4fc8-94cf-4625f11459ba tempest-CreateVolumesFromSnapshotTest-1940402819 None] Lock "cinder-c41b6e62-a48b-4b43-b9f1-d2ec330fcd4b-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:38 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk" returned: 1 in 0.515s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1786ad67-8357-4f6d-8187-c1b982d71165_zz7tiuyk' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db8df86-74ef-4deb-a0a6-fc04be49f97c]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:38 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD Nov 02 18:01:38 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Flow 'volume_create_manager' (ea7b1eae-0a86-480f-8075-285859978f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d6cdb9-c1a0-4322-8322-7e7839dd8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=166,cinder:UPDATE=214,cinder:INSERT=57,cinder:DELETE=10 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78d6cdb9-c1a0-4322-8322-7e7839dd8718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1650117584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a640b3ea-42dc-4b41-862e-9f6a360d88d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e76abcec3a64cfcab3efdcee253e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:38Z,use_quota=True,user_id='481812a25cd142bfb47688aa021bffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1cfd0-f2c1-442e-8063-49c415cb1207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1cfd0-f2c1-442e-8063-49c415cb1207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847c0ae0-4969-4d23-b71e-b990c737ce11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847c0ae0-4969-4d23-b71e-b990c737ce11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a640b3ea-42dc-4b41-862e-9f6a360d88d1', 'volume_name': 'volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1b1530-cc2f-4091-827a-c0fd55d21489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d1b1530-cc2f-4091-827a-c0fd55d21489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffe0b23-9845-4ce2-a8d2-998df8ff93b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:38 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Volume a640b3ea-42dc-4b41-862e-9f6a360d88d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1', 'volume_size': 1} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1650117584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a640b3ea-42dc-4b41-862e-9f6a360d88d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e76abcec3a64cfcab3efdcee253e3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:38Z,use_quota=True,user_id='481812a25cd142bfb47688aa021bffaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Creating volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:38 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:38 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:38 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 1073741824 Nov 02 18:01:38 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:38 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD Nov 02 18:01:38 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:39 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD" returned: 1 in 0.435s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] 1786ad67-8357-4f6d-8187-c1b982d71165 was raw, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:39 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 Nov 02 18:01:39 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:39 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 1073741824" returned: 0 in 0.615s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=147,cinder:UPDATE=195,cinder:INSERT=56,cinder:DELETE=23 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:39 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 Nov 02 18:01:39 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:39 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1" returned: 0 in 0.354s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:39 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627" returned: 0 in 0.547s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1786ad67-8357-4f6d-8187-c1b982d71165_tz84kf08devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:01:39 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffe0b23-9845-4ce2-a8d2-998df8ff93b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a2c29-ea5b-4981-8983-daf0ff1ab77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:39 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 1G Nov 02 18:01:39 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:39 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Volume volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 (a640b3ea-42dc-4b41-862e-9f6a360d88d1): created successfully Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784a2c29-ea5b-4981-8983-daf0ff1ab77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Flow 'volume_create_manager' (ea7b1eae-0a86-480f-8075-285859978f73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-625cbefe-c002-426c-9756-846c51daa1bc tempest-VolumesSnapshotListTestJSON-24810384 None] Created volume successfully. Nov 02 18:01:40 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 1G" returned: 0 in 0.393s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Downloaded image 1786ad67-8357-4f6d-8187-c1b982d71165 ((None, [{'url': 'file:///opt/stack/data/glance/images/1786ad67-8357-4f6d-8187-c1b982d71165', 'metadata': {}}])) to volume b7a71a3c-aa22-4333-b679-af2e9cfcc627 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Temporary image 1786ad67-8357-4f6d-8187-c1b982d71165 for user c1d537bf6f1c47eab74e85a1e403d9c7 is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Marking volume b7a71a3c-aa22-4333-b679-af2e9cfcc627 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Copying metadata from image 1786ad67-8357-4f6d-8187-c1b982d71165 to b7a71a3c-aa22-4333-b679-af2e9cfcc627. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Creating volume glance metadata for volume b7a71a3c-aa22-4333-b679-af2e9cfcc627 backed by image 1786ad67-8357-4f6d-8187-c1b982d71165 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1dfb369df43a4e5ac49d76f564bd1dec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a0412a-efe6-4623-8344-758820ff706f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627', 'volume_size': 1, 'image_id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1786ad67-8357-4f6d-8187-c1b982d71165', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1dfb369df43a4e5ac49d76f564bd1dec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c544c88806ad451f9ec102298ec6a610', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '110771e4ee39bf2dcab4f1f79551636ea2db967b3750bae24fdb35f2aea4c47356ba65e2a0304faf800ebbf6efd06c97b653cd57f4c272df729787f788cd53f2', 'id': '1786ad67-8357-4f6d-8187-c1b982d71165', 'created_at': datetime.datetime(2026, 11, 2, 17, 1, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 1, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1786ad67-8357-4f6d-8187-c1b982d71165/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0134bc-9346-4462-a61f-cdb929fdfc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Volume volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 (b7a71a3c-aa22-4333-b679-af2e9cfcc627): created successfully Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0134bc-9346-4462-a61f-cdb929fdfc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Flow 'volume_create_manager' (66b4b6ba-bd22-4481-ab43-5e8cffc13309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3938bda8-f462-454d-aec7-5f83b1126b9a tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Created volume successfully. Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Creating offline snapshot 08df5115-e0d0-4a44-a553-5c55ebe6341d of volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0115b8f9-8c78-466f-86fc-20166df24527]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:40 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 Nov 02 18:01:40 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Acquiring lock "cinder-b7a71a3c-aa22-4333-b679-af2e9cfcc627-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "cinder-b7a71a3c-aa22-4333-b679-af2e9cfcc627-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Acquiring lock "cinder-quobyte-b7a71a3c-aa22-4333-b679-af2e9cfcc627" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:41 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1" returned: 0 in 0.411s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "cinder-quobyte-b7a71a3c-aa22-4333-b679-af2e9cfcc627" acquired by "delete_volume" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:41 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d 1G Nov 02 18:01:41 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f0cc3-df86-44f4-a02d-e3f14ee9564b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:41 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 Nov 02 18:01:41 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:41 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d 1G" returned: 0 in 0.444s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:41 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627" returned: 0 in 0.416s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:41 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:41 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:41 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627 Nov 02 18:01:41 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:42 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b7a71a3c-aa22-4333-b679-af2e9cfcc627" returned: 0 in 0.296s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:42 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "cinder-quobyte-b7a71a3c-aa22-4333-b679-af2e9cfcc627" released by "delete_volume" :: held 0.774s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.347s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:42 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d is being set with open permissions: ugo+rw Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:42 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:42 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:42 devstack cinder-volume[86585]: WARNING cinder.quota [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 18:01:42 devstack cinder-volume[86585]: WARNING cinder.quota [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Created reservations ['08804a72-96e6-4e10-a93e-eb68a39a9065', 'e534e382-1114-4b44-9207-62461581fd0b', 'e1d82f85-2e31-40fb-894a-d8be2387205f', 'e95d8f04-a688-4018-928a-cdbbbf5ad3f0'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:42 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:42 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Flow 'volume_create_manager' (e3aa2209-b061-4004-ac83-4ca952a51806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3cb6bf-20ef-4f76-88cb-66cef2818c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3cb6bf-20ef-4f76-88cb-66cef2818c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-250960679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6fb982-4140-4976-b367-3c9f2b9c08cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d46b260d36f472c991ee6e338fea0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:42Z,use_quota=True,user_id='6bc643d34bf94988bcb824e7d92ecad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f1fbde-7894-4a22-8a50-c4f46f5074c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f1fbde-7894-4a22-8a50-c4f46f5074c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badee1c4-b722-45b4-8b13-22345a81b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badee1c4-b722-45b4-8b13-22345a81b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6fb982-4140-4976-b367-3c9f2b9c08cf', 'volume_name': 'volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4090ec-19bd-47bf-ab13-7a807a2ebef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a4090ec-19bd-47bf-ab13-7a807a2ebef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:42 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4e7dc9-187b-4e02-99a6-49d1699ce8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:42 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Volume ff6fb982-4140-4976-b367-3c9f2b9c08cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf', 'volume_size': 1} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.324s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:42 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info Nov 02 18:01:42 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:42 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.337s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:42 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Deleted volume successfully. Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-a1817702-47de-4d64-aadb-da84d3dfb94f tempest-VolumeAndVolumeTypeFromImageTest-1811597976 None] Lock "cinder-b7a71a3c-aa22-4333-b679-af2e9cfcc627-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:42 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info" returned: 0 in 0.272s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:42 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info is being set with open permissions: ugo+rw Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:42 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info Nov 02 18:01:42 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:42 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.info" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-250960679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6fb982-4140-4976-b367-3c9f2b9c08cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d46b260d36f472c991ee6e338fea0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:42Z,use_quota=True,user_id='6bc643d34bf94988bcb824e7d92ecad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Creating volume ff6fb982-4140-4976-b367-3c9f2b9c08cf {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:42 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:43 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf 1073741824 Nov 02 18:01:43 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7bf23d62-dbb3-4605-8f98-6fe0fd488cf3 tempest-VolumesSnapshotListTestJSON-24810384 None] Create snapshot completed successfully Nov 02 18:01:43 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf 1073741824" returned: 0 in 0.546s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:43 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf Nov 02 18:01:43 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:43 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc4e7dc9-187b-4e02-99a6-49d1699ce8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20749b87-d644-4629-8894-b2618fd54b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:43 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Volume volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf (ff6fb982-4140-4976-b367-3c9f2b9c08cf): created successfully Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20749b87-d644-4629-8894-b2618fd54b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Flow 'volume_create_manager' (e3aa2209-b061-4004-ac83-4ca952a51806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-da437585-4e25-4114-aa7e-c52b40550031 tempest-VolumesTransfersTest-2114368228 None] Created volume successfully. Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Creating offline snapshot c909cfd3-45fd-4b22-92d6-b2a110cb2bdf of volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed984020-bce8-4331-b7f9-e7cf16f8838d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:44 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:44 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:44 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.451s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:44 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf 1G Nov 02 18:01:44 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:45 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf 1G" returned: 0 in 0.574s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:45 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:45 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5e78030b-d587-47f5-8f3b-f96107b51fc7 tempest-VolumesTransfersTest-1884292566 None] Transfer volume completed successfully. Nov 02 18:01:45 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.342s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:45 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf is being set with open permissions: ugo+rw Nov 02 18:01:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:45 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:45 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:45 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.291s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Acquiring lock "cinder-ff6fb982-4140-4976-b367-3c9f2b9c08cf-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:46 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5cd6dac6-3ae4-4f76-a5ac-c0d48bc12866 tempest-VolumesSnapshotListTestJSON-24810384 None] Create snapshot completed successfully Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Lock "cinder-ff6fb982-4140-4976-b367-3c9f2b9c08cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Acquiring lock "cinder-quobyte-ff6fb982-4140-4976-b367-3c9f2b9c08cf" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Lock "cinder-quobyte-ff6fb982-4140-4976-b367-3c9f2b9c08cf" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c82480-f438-4023-bf98-35fc2fba5634]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:46 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf Nov 02 18:01:46 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Creating offline snapshot 1c2f089e-4541-48e2-989c-924dd3165096 of volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:01:46 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf" returned: 0 in 0.403s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee00560b-4134-4e0c-bad4-db0c2bff7e89]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:46 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf Nov 02 18:01:46 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:46 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:46 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:46 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:46 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:46 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ff6fb982-4140-4976-b367-3c9f2b9c08cf" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Lock "cinder-quobyte-ff6fb982-4140-4976-b367-3c9f2b9c08cf" released by "delete_volume" :: held 0.737s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Created reservations ['f7bd6f22-2b87-4782-81f1-f5277ffbe666', 'e1635978-1aa5-453a-9bb2-ffb4a1c09cf1', 'beb2d243-9bac-4dba-9e8f-5928703f9387', 'd07cdbc9-1459-47f6-9721-ce842a9602b3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:46 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.307s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:46 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.443s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:47 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:47 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:47 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 1G Nov 02 18:01:47 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:47 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Deleted volume successfully. Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-059421cd-865d-4f89-9f12-704b7c0dfff4 tempest-VolumesTransfersTest-574453630 None] Lock "cinder-ff6fb982-4140-4976-b367-3c9f2b9c08cf-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:47 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 1G" returned: 0 in 0.602s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:47 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 Nov 02 18:01:47 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Flow 'volume_create_manager' (5216a773-bfce-45f7-8a8d-66dbbb5d45f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dce8e6-cc04-4c6e-9b13-1845a8bb9299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0dce8e6-cc04-4c6e-9b13-1845a8bb9299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-70832436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137eeae8-84ac-4d14-bcc6-c91e04ff480f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d46b260d36f472c991ee6e338fea0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:48Z,use_quota=True,user_id='6bc643d34bf94988bcb824e7d92ecad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f903bd3-7654-4189-91c7-431ef18513fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f903bd3-7654-4189-91c7-431ef18513fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6c66c0-0a0b-49c7-b5e9-fc716de5174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6c66c0-0a0b-49c7-b5e9-fc716de5174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '137eeae8-84ac-4d14-bcc6-c91e04ff480f', 'volume_name': 'volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91a4840-a71a-417f-b1e4-2757939f1ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91a4840-a71a-417f-b1e4-2757939f1ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8847db30-0c81-4939-ae05-0cc0fe14e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:47 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Volume 137eeae8-84ac-4d14-bcc6-c91e04ff480f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f', 'volume_size': 1} Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:47 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:47 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 is being set with open permissions: ugo+rw Nov 02 18:01:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:47 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 Nov 02 18:01:47 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:48 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.756s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-70832436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=137eeae8-84ac-4d14-bcc6-c91e04ff480f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d46b260d36f472c991ee6e338fea0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:48Z,use_quota=True,user_id='6bc643d34bf94988bcb824e7d92ecad8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Creating volume 137eeae8-84ac-4d14-bcc6-c91e04ff480f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:48 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:48 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f 1073741824 Nov 02 18:01:48 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:48 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a1b93147-8fe2-4d96-9151-6fc6e6c41482 tempest-VolumesSnapshotListTestJSON-24810384 None] Create snapshot completed successfully Nov 02 18:01:48 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f 1073741824" returned: 0 in 0.484s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:48 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f Nov 02 18:01:48 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:49 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f" returned: 0 in 0.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8847db30-0c81-4939-ae05-0cc0fe14e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcadfc4e-6334-49bc-ba8f-bdc69d74fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:49 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Volume volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f (137eeae8-84ac-4d14-bcc6-c91e04ff480f): created successfully Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcadfc4e-6334-49bc-ba8f-bdc69d74fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Flow 'volume_create_manager' (5216a773-bfce-45f7-8a8d-66dbbb5d45f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dade598a-8f90-48c2-b99c-6e1b7a5241e2 tempest-VolumesTransfersTest-2114368228 None] Created volume successfully. Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-1c2f089e-4541-48e2-989c-924dd3165096-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-1c2f089e-4541-48e2-989c-924dd3165096-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-1c2f089e-4541-48e2-989c-924dd3165096" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-1c2f089e-4541-48e2-989c-924dd3165096" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Deleting offline snapshot 1c2f089e-4541-48e2-989c-924dd3165096 of volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] snapshot_file for this snap is: volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d237b331-8542-42ea-b33a-c2581b8e4188]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Flow 'volume_create_manager' (6e75f874-f98e-4e86-aa57-b4bfb08b4ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dcec57-4f8c-489a-9fc7-716d2a0b5cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34dcec57-4f8c-489a-9fc7-716d2a0b5cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4edea7-f069-4536-9932-8ac5965af1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b056d50cb72404b9d27d617597d9d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:50Z,use_quota=True,user_id='ced078a554724189986c07482e85e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1414a85d-4655-452a-8682-c2710d937c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1414a85d-4655-452a-8682-c2710d937c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4e2594-09de-439d-a644-94c6e4514bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:49 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 18:01:49 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 Nov 02 18:01:49 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4e2594-09de-439d-a644-94c6e4514bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee4edea7-f069-4536-9932-8ac5965af1d8', 'volume_name': 'volume-ee4edea7-f069-4536-9932-8ac5965af1d8', 'volume_size': 1, 'image_id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a6a5744-d584-4fb5-8072-6d160ec90919', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45f066678d4a2088bff05d80b7373bd2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b056d50cb72404b9d27d617597d9d96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0d92cd95fae16f567282c380ea42c84db7d65671e087582919b6ae0300218fe45827a2b201dcd04a0bb14bafee2160ea123472d1926993de116c9d86ffcb08c', 'id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'created_at': datetime.datetime(2026, 11, 2, 17, 1, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 1, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a6a5744-d584-4fb5-8072-6d160ec90919/file', 'properties': {}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35808afa-18c6-4529-a24c-2a7fdc1d3759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35808afa-18c6-4529-a24c-2a7fdc1d3759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a7f216-1936-4bd6-817f-fce3e335ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:50 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Volume ee4edea7-f069-4536-9932-8ac5965af1d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee4edea7-f069-4536-9932-8ac5965af1d8', 'volume_size': 1, 'image_id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a6a5744-d584-4fb5-8072-6d160ec90919', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45f066678d4a2088bff05d80b7373bd2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b056d50cb72404b9d27d617597d9d96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0d92cd95fae16f567282c380ea42c84db7d65671e087582919b6ae0300218fe45827a2b201dcd04a0bb14bafee2160ea123472d1926993de116c9d86ffcb08c', 'id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'created_at': datetime.datetime(2026, 11, 2, 17, 1, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 1, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a6a5744-d584-4fb5-8072-6d160ec90919/file', 'properties': {}}, 'image_service': } Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Trying to clone ee4edea7-f069-4536-9932-8ac5965af1d8 from image 4a6a5744-d584-4fb5-8072-6d160ec90919 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a6a5744-d584-4fb5-8072-6d160ec90919', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 18:01:50 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096" returned: 0 in 0.443s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c28d6-f877-4abf-9d47-c108c23d5fb7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 18:01:50 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Image download 0.00 MB at 0.00 MB/s Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Acquiring lock "cinder-137eeae8-84ac-4d14-bcc6-c91e04ff480f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9604f69-2a62-44f2-aba7-6f7f60d93f1e]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Lock "cinder-137eeae8-84ac-4d14-bcc6-c91e04ff480f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:50 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:50 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Acquiring lock "cinder-quobyte-137eeae8-84ac-4d14-bcc6-c91e04ff480f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Lock "cinder-quobyte-137eeae8-84ac-4d14-bcc6-c91e04ff480f" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af2ec7d-f611-4514-8e1f-205247957776]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:50 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD Nov 02 18:01:50 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:50 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f Nov 02 18:01:50 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:50 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.414s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:50 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 Nov 02 18:01:50 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:50 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:50 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD Nov 02 18:01:50 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:50 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f" returned: 0 in 0.425s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:50 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f Nov 02 18:01:50 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:51 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Temporary image 4a6a5744-d584-4fb5-8072-6d160ec90919 is fetched for user ced078a554724189986c07482e85e4c5. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096" returned: 0 in 0.455s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:51 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-137eeae8-84ac-4d14-bcc6-c91e04ff480f" returned: 0 in 0.274s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096 Nov 02 18:01:51 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Lock "cinder-quobyte-137eeae8-84ac-4d14-bcc6-c91e04ff480f" released by "delete_volume" :: held 0.746s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[24457fff-892b-4c31-b9b5-801bf823ce79]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Created reservations ['5a919b5b-b587-4d52-91bf-d9c7db9c34e2', '3d12d4f5-57a3-4a36-87f3-f78669b2300d', '5b560b74-ffae-4e66-a8b9-24c32c7c8248', '3afb69d0-4a1e-4ba7-9017-9934405e34ee'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:51 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD Nov 02 18:01:51 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:51 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:51 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:51 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.1c2f089e-4541-48e2-989c-924dd3165096" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-1c2f089e-4541-48e2-989c-924dd3165096" released by "_delete_snapshot" :: held 1.730s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" released by "delete_snapshot" :: held 1.755s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Created reservations ['2b900526-99e7-4599-aec3-2a6243f61bd7', 'd42c73d4-a031-4310-8e29-b68eba434155', '2205925d-787b-42af-8c3f-c8f03f62a7ae', '37c42016-dbf6-4b9a-b05a-47df27cebc02'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Delete snapshot completed successfully. Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77958f10-50eb-4f73-8a36-0a56ab652d9a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-1c2f089e-4541-48e2-989c-924dd3165096-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:51 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:51 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Deleted volume successfully. Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e3d532e7-7e53-46c6-8c33-060683b695db tempest-VolumesTransfersTest-574453630 None] Lock "cinder-137eeae8-84ac-4d14-bcc6-c91e04ff480f-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:51 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD Nov 02 18:01:51 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-c909cfd3-45fd-4b22-92d6-b2a110cb2bdf-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-c909cfd3-45fd-4b22-92d6-b2a110cb2bdf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Deleting offline snapshot c909cfd3-45fd-4b22-92d6-b2a110cb2bdf of volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] snapshot_file for this snap is: volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[de793775-4737-43c8-934f-7c0a5baf4501]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:51 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD" returned: 1 in 0.391s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee4edea7-f069-4536-9932-8ac5965af1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b056d50cb72404b9d27d617597d9d96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:50Z,use_quota=True,user_id='ced078a554724189986c07482e85e4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Creating volume ee4edea7-f069-4536-9932-8ac5965af1d8 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:51 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:52 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:52 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:52 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 1073741824 Nov 02 18:01:52 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:52 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.432s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db1b277-be88-40c7-a63f-cf40b1fdd8f2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:52 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:52 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:52 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 1073741824" returned: 0 in 0.517s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:52 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 Nov 02 18:01:52 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:52 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:52 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.449s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8" returned: 0 in 0.274s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:52 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:52 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Attempting download of 4a6a5744-d584-4fb5-8072-6d160ec90919 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a6a5744-d584-4fb5-8072-6d160ec90919', 'metadata': {}}])) to volume ee4edea7-f069-4536-9932-8ac5965af1d8. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[17db46dc-c138-47bd-bac8-8e6d3d5b61d9]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:53 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp Nov 02 18:01:53 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:53 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.459s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:53 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:53 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf Nov 02 18:01:53 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:53 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp Nov 02 18:01:53 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:53 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" returned: 0 in 0.266s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-c909cfd3-45fd-4b22-92d6-b2a110cb2bdf" released by "_delete_snapshot" :: held 1.728s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" released by "delete_snapshot" :: held 1.757s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Created reservations ['e6e78f0b-2ce3-46a8-a535-23892df73892', '03b269ad-1f09-4ff0-993e-aa06e78ca64a', '11d0e39d-0feb-4580-9a55-0c9564c97273', '5edc4b0d-c231-460a-a9f3-87b4241eddde'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:53 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp" returned: 1 in 0.386s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a6a5744-d584-4fb5-8072-6d160ec90919_6vwg8etp' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8935159-cd95-4889-b3c8-9237c8d63e84]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Delete snapshot completed successfully. Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-906e3270-9504-424f-a828-64c94e8e2be5 tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-c909cfd3-45fd-4b22-92d6-b2a110cb2bdf-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:53 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD Nov 02 18:01:53 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-08df5115-e0d0-4a44-a553-5c55ebe6341d-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-08df5115-e0d0-4a44-a553-5c55ebe6341d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-08df5115-e0d0-4a44-a553-5c55ebe6341d" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-08df5115-e0d0-4a44-a553-5c55ebe6341d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Deleting offline snapshot 08df5115-e0d0-4a44-a553-5c55ebe6341d of volume a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:01:54 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] snapshot_file for this snap is: volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[48094a02-8131-47e7-b7b0-01e796178678]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:54 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD Nov 02 18:01:54 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:54 devstack sudo[103551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:54 devstack sudo[103551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:54 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] 4a6a5744-d584-4fb5-8072-6d160ec90919 was raw, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:54 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 Nov 02 18:01:54 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:54 devstack sudo[103551]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.417s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd9e55b-0dd6-463c-bead-fef7014df74a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:54 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 Nov 02 18:01:54 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:54 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1" returned: 0 in 0.432s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:55 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:55 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:55 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8" returned: 0 in 0.608s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a6a5744-d584-4fb5-8072-6d160ec90919_uyw50t_2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:01:55 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:55 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 1G Nov 02 18:01:55 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:55 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.435s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:55 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 1G" returned: 0 in 0.364s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Downloaded image 4a6a5744-d584-4fb5-8072-6d160ec90919 ((None, [{'url': 'file:///opt/stack/data/glance/images/4a6a5744-d584-4fb5-8072-6d160ec90919', 'metadata': {}}])) to volume ee4edea7-f069-4536-9932-8ac5965af1d8 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Temporary image 4a6a5744-d584-4fb5-8072-6d160ec90919 for user ced078a554724189986c07482e85e4c5 is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Marking volume ee4edea7-f069-4536-9932-8ac5965af1d8 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 18:01:55 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d Nov 02 18:01:55 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Copying metadata from image 4a6a5744-d584-4fb5-8072-6d160ec90919 to ee4edea7-f069-4536-9932-8ac5965af1d8. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Creating volume glance metadata for volume ee4edea7-f069-4536-9932-8ac5965af1d8 backed by image 4a6a5744-d584-4fb5-8072-6d160ec90919 with: {'image_id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '45f066678d4a2088bff05d80b7373bd2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a7f216-1936-4bd6-817f-fce3e335ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee4edea7-f069-4536-9932-8ac5965af1d8', 'volume_size': 1, 'image_id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a6a5744-d584-4fb5-8072-6d160ec90919', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45f066678d4a2088bff05d80b7373bd2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7b056d50cb72404b9d27d617597d9d96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b0d92cd95fae16f567282c380ea42c84db7d65671e087582919b6ae0300218fe45827a2b201dcd04a0bb14bafee2160ea123472d1926993de116c9d86ffcb08c', 'id': '4a6a5744-d584-4fb5-8072-6d160ec90919', 'created_at': datetime.datetime(2026, 11, 2, 17, 1, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 1, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a6a5744-d584-4fb5-8072-6d160ec90919/file', 'properties': {}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b69d07-59ab-450b-bbd3-fb2bc522ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:55 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Volume volume-ee4edea7-f069-4536-9932-8ac5965af1d8 (ee4edea7-f069-4536-9932-8ac5965af1d8): created successfully Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b69d07-59ab-450b-bbd3-fb2bc522ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Flow 'volume_create_manager' (6e75f874-f98e-4e86-aa57-b4bfb08b4ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d48b2433-a7e9-4c47-abdf-d6cde5c2f21e tempest-VolumeImageDependencyTests-246450060 None] Created volume successfully. Nov 02 18:01:55 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1.08df5115-e0d0-4a44-a553-5c55ebe6341d" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-08df5115-e0d0-4a44-a553-5c55ebe6341d" released by "_delete_snapshot" :: held 1.715s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" released by "delete_snapshot" :: held 1.757s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Created reservations ['9ae3dea1-7411-4e12-b9cc-9bbe4a8eb3b6', '4fa3abf6-8b40-4128-a3a3-1e9c65370b09', '5a9fa368-8274-44d8-b37a-40922d067b23', '5b62b861-4862-45ad-a79b-bd3963483411'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:55 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Delete snapshot completed successfully. Nov 02 18:01:55 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3ac034dc-88ee-4ca9-a360-3374b2b11dbc tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-08df5115-e0d0-4a44-a553-5c55ebe6341d-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Acquiring lock "cinder-ee4edea7-f069-4536-9932-8ac5965af1d8-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Lock "cinder-ee4edea7-f069-4536-9932-8ac5965af1d8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-a640b3ea-42dc-4b41-862e-9f6a360d88d1-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Acquiring lock "cinder-quobyte-ee4edea7-f069-4536-9932-8ac5965af1d8" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-a640b3ea-42dc-4b41-862e-9f6a360d88d1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Lock "cinder-quobyte-ee4edea7-f069-4536-9932-8ac5965af1d8" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3494732e-234f-475d-8a90-c63ac0af24f4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc7d1e-cc57-40bb-b8bf-d353ab5409f2]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:56 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 Nov 02 18:01:56 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:56 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 Nov 02 18:01:56 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:56 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:56 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8 Nov 02 18:01:56 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:56 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1" returned: 0 in 0.415s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:56 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1 Nov 02 18:01:56 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:57 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ee4edea7-f069-4536-9932-8ac5965af1d8" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Lock "cinder-quobyte-ee4edea7-f069-4536-9932-8ac5965af1d8" released by "delete_volume" :: held 0.760s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:57 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a640b3ea-42dc-4b41-862e-9f6a360d88d1" returned: 0 in 0.279s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-quobyte-a640b3ea-42dc-4b41-862e-9f6a360d88d1" released by "delete_volume" :: held 0.770s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Created reservations ['59f276be-1d69-425b-b7e7-98eff4e5eb8f', '4be24dd2-dbcf-44ed-a4dd-6595490f1517', '37df5457-f864-4755-8356-fe2701d3adf5', '7c87cb75-e8a3-4fbd-9e7e-92f9d86fe71f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Created reservations ['e40ae663-1046-46ed-aa5f-440f876adfcc', '2716adbc-3644-459f-b4c0-0cebc6298993', '19c0abff-392b-4767-85f0-931809adab5d', '9a9eb4d5-770b-463a-937d-6f2562c348d0'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:57 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:57 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:57 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:01:57 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:57 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.332s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Deleted volume successfully. Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bb55a6b6-de40-4c18-863c-cc265e924dde tempest-VolumeImageDependencyTests-246450060 None] Lock "cinder-ee4edea7-f069-4536-9932-8ac5965af1d8-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:57 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.329s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:01:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Deleted volume successfully. Nov 02 18:01:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c68da1d8-77d3-4e63-912c-a873bbd2259a tempest-VolumesSnapshotListTestJSON-24810384 None] Lock "cinder-a640b3ea-42dc-4b41-862e-9f6a360d88d1-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Flow 'volume_create_manager' (d00cd133-fc09-401f-8806-ba66cf326280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1680e8c9-5177-49b8-a9f0-6ee8084a4e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1680e8c9-5177-49b8-a9f0-6ee8084a4e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-569762078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c49e03-70eb-4a4f-9b12-903ff52a0b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13334cdb25c4485a8a8de150f9b2ed71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:59Z,use_quota=True,user_id='0329227901794adf912673b304d14479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160b28c5-f3d5-4e2d-8fe0-f7bddf06ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160b28c5-f3d5-4e2d-8fe0-f7bddf06ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11406581-a59b-4c67-b0ad-46b5fda16b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11406581-a59b-4c67-b0ad-46b5fda16b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'volume_name': 'volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0591c5a-efeb-4450-b07f-6c16f76649a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0591c5a-efeb-4450-b07f-6c16f76649a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcfe4c0-2396-4618-be4c-cfc620ca81b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:01:59 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Volume a6c49e03-70eb-4a4f-9b12-903ff52a0b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'volume_size': 1} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-569762078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c49e03-70eb-4a4f-9b12-903ff52a0b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13334cdb25c4485a8a8de150f9b2ed71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:01:59Z,use_quota=True,user_id='0329227901794adf912673b304d14479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Creating volume a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:01:59 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:59 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c 1073741824 Nov 02 18:01:59 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:01:59 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c 1073741824" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:01:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:01:59 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c Nov 02 18:01:59 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:00 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddcfe4c0-2396-4618-be4c-cfc620ca81b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cedddc-8254-486c-a86d-cf5e24c741f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Volume volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c (a6c49e03-70eb-4a4f-9b12-903ff52a0b0c): created successfully Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56cedddc-8254-486c-a86d-cf5e24c741f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Flow 'volume_create_manager' (d00cd133-fc09-401f-8806-ba66cf326280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ae094144-dc69-49c9-814a-200b623b7b06 tempest-VolumesCloneTest-1747485854 None] Created volume successfully. Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Flow 'volume_create_manager' (3523b5ef-d76c-413f-a039-f5f0c2285a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc79af52-dae3-421a-9f06-04dc829206b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc79af52-dae3-421a-9f06-04dc829206b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210808cd-239f-445b-a6f8-cd08fb5630f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82fcf2602b64317810e648e10396f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:01Z,use_quota=True,user_id='603b639da9754691ad08582de9a38395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b06643e-21e8-400b-a6b1-021f21cb3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b06643e-21e8-400b-a6b1-021f21cb3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078a8312-21e9-47d4-9e9a-522398ae16c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078a8312-21e9-47d4-9e9a-522398ae16c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210808cd-239f-445b-a6f8-cd08fb5630f6', 'volume_name': 'volume-210808cd-239f-445b-a6f8-cd08fb5630f6', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8e99f0-cc66-42b1-a41d-7a14eb68c6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8e99f0-cc66-42b1-a41d-7a14eb68c6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7ccbc2-caec-4b2c-b2cf-bc42d8607725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Volume 210808cd-239f-445b-a6f8-cd08fb5630f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210808cd-239f-445b-a6f8-cd08fb5630f6', 'volume_size': 1} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210808cd-239f-445b-a6f8-cd08fb5630f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82fcf2602b64317810e648e10396f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:01Z,use_quota=True,user_id='603b639da9754691ad08582de9a38395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Creating volume 210808cd-239f-445b-a6f8-cd08fb5630f6 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:02:01 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:01 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 1073741824 Nov 02 18:02:01 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Flow 'volume_create_manager' (7ae79ced-90e2-4e6b-8a55-9d05e98cce2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6e5f66-cc18-4369-87df-e32e07e6a6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6e5f66-cc18-4369-87df-e32e07e6a6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-860999916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=204a1102-b521-47c8-a54e-440cd5456d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13334cdb25c4485a8a8de150f9b2ed71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a6c49e03-70eb-4a4f-9b12-903ff52a0b0c,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:02Z,use_quota=True,user_id='0329227901794adf912673b304d14479',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c75b891-19de-4324-9ebf-21d7a537f22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c75b891-19de-4324-9ebf-21d7a537f22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f44105-0858-4078-b5c0-ac6266c3aa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f44105-0858-4078-b5c0-ac6266c3aa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '204a1102-b521-47c8-a54e-440cd5456d01', 'volume_name': 'volume-204a1102-b521-47c8-a54e-440cd5456d01', 'volume_size': 2, 'source_volid': 'a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'source_volstatus': 'available'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d48832-cd3c-4ceb-a1b0-66201c747b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d48832-cd3c-4ceb-a1b0-66201c747b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fcb5d1-ef45-46a4-bb4f-70ce578b675a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Volume 204a1102-b521-47c8-a54e-440cd5456d01: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-204a1102-b521-47c8-a54e-440cd5456d01', 'volume_size': 2, 'source_volid': 'a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'source_volstatus': 'available'} Nov 02 18:02:02 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 1073741824" returned: 0 in 0.579s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:02 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 Nov 02 18:02:02 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:02 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.286s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:02 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Cloning volume a6c49e03-70eb-4a4f-9b12-903ff52a0b0c to volume 204a1102-b521-47c8-a54e-440cd5456d01 Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7ccbc2-caec-4b2c-b2cf-bc42d8607725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210808cd-239f-445b-a6f8-cd08fb5630f6', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdf6711-a7fe-4154-a50e-a095a34dfd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Volume volume-210808cd-239f-445b-a6f8-cd08fb5630f6 (210808cd-239f-445b-a6f8-cd08fb5630f6): created successfully Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdf6711-a7fe-4154-a50e-a095a34dfd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Flow 'volume_create_manager' (3523b5ef-d76c-413f-a039-f5f0c2285a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Creating offline snapshot 39cec65e-c4fb-4d63-8827-999068db8981 of volume a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:02:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ac1f56db-4efe-4d5d-8214-92ff31eef799 tempest-CinderUnicodeTest-1252799091 None] Created volume successfully. Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb0bb0e-e70c-4541-b655-cb4305ab7c40]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:02 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c Nov 02 18:02:02 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:02 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" returned: 0 in 0.370s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:02 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 1G Nov 02 18:02:02 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:03 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 1G" returned: 0 in 0.451s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:03 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 Nov 02 18:02:03 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:03 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981" returned: 0 in 0.324s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:03 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 is being set with open permissions: ugo+rw Nov 02 18:02:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:03 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 Nov 02 18:02:03 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:03 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981" returned: 0 in 0.288s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:03 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info Nov 02 18:02:03 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Flow 'volume_create_manager' (aea2fd7c-4c7f-4c88-94f8-e7fc8422bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4579027e-0acc-4631-9b00-67dca03f8083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4579027e-0acc-4631-9b00-67dca03f8083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-428799251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f65649-ea48-4e6a-a153-c5254c9af1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82fcf2602b64317810e648e10396f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:04Z,use_quota=True,user_id='603b639da9754691ad08582de9a38395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e595c2-f1aa-4d61-8fe9-54d0fb08e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e595c2-f1aa-4d61-8fe9-54d0fb08e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e91cf30-2a42-4ef1-b397-10d4f4f7a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e91cf30-2a42-4ef1-b397-10d4f4f7a547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40f65649-ea48-4e6a-a153-c5254c9af1a6', 'volume_name': 'volume-40f65649-ea48-4e6a-a153-c5254c9af1a6', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4c3097-62fd-47c6-bf18-88b91526cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4c3097-62fd-47c6-bf18-88b91526cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33cd34-c468-4492-8098-cc3a9baced68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Volume 40f65649-ea48-4e6a-a153-c5254c9af1a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40f65649-ea48-4e6a-a153-c5254c9af1a6', 'volume_size': 1} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:04 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:04 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info is being set with open permissions: ugo+rw Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:04 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info Nov 02 18:02:04 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:04 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.info" returned: 0 in 0.263s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Acquiring lock "cinder-quobyte-204a1102-b521-47c8-a54e-440cd5456d01" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-204a1102-b521-47c8-a54e-440cd5456d01" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] snapshot: 39cec65e-c4fb-4d63-8827-999068db8981, volume: 204a1102-b521-47c8-a54e-440cd5456d01, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82f16d1-5bfb-4222-8c98-2b2f9cab08eb]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:04 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 Nov 02 18:02:04 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:04 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981" returned: 0 in 0.369s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1da5975-8110-456d-9d60-0fb3482a41c7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:05 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c Nov 02 18:02:05 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:05 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" returned: 0 in 0.403s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:02:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:02:05 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:02:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:05 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 Nov 02 18:02:05 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:13 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01" returned: 0 in 8.209s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:02:13 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Converted 1024.00 MB image at 124.72 MB/s Nov 02 18:02:13 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 is being set with open permissions: ugo+rw Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:13 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 Nov 02 18:02:13 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:13 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01" returned: 0 in 0.243s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-204a1102-b521-47c8-a54e-440cd5456d01" released by "_copy_volume_from_snapshot" :: held 9.308s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Acquiring lock "cinder-quobyte-39cec65e-c4fb-4d63-8827-999068db8981" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-39cec65e-c4fb-4d63-8827-999068db8981" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Deleting offline snapshot 39cec65e-c4fb-4d63-8827-999068db8981 of volume a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] snapshot_file for this snap is: volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef06306d-b429-4b26-97bc-578ef188af97]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:13 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 Nov 02 18:02:13 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=73,cinder:DELETE=10,cinder:SELECT=85,cinder:INSERT=27 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:02:14 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981" returned: 0 in 0.397s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7018c6-6958-4498-8b08-24586e14c6fa]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:14 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c Nov 02 18:02:14 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:14 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" returned: 0 in 0.575s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:14 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 Nov 02 18:02:14 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:15 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981" returned: 0 in 0.372s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:15 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981 Nov 02 18:02:15 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:15 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c.39cec65e-c4fb-4d63-8827-999068db8981" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-39cec65e-c4fb-4d63-8827-999068db8981" released by "_delete_snapshot" :: held 1.711s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.230s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.500s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-428799251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f65649-ea48-4e6a-a153-c5254c9af1a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82fcf2602b64317810e648e10396f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:04Z,use_quota=True,user_id='603b639da9754691ad08582de9a38395',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Creating volume 40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:02:15 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fcb5d1-ef45-46a4-bb4f-70ce578b675a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-204a1102-b521-47c8-a54e-440cd5456d01', 'volume_size': 2, 'source_volid': 'a6c49e03-70eb-4a4f-9b12-903ff52a0b0c', 'source_volstatus': 'available'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:15 devstack sudo[103709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 1073741824 Nov 02 18:02:15 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a41f3b5-5b07-4979-ae0e-80e669360c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Volume volume-204a1102-b521-47c8-a54e-440cd5456d01 (204a1102-b521-47c8-a54e-440cd5456d01): created successfully Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a41f3b5-5b07-4979-ae0e-80e669360c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Flow 'volume_create_manager' (7ae79ced-90e2-4e6b-8a55-9d05e98cce2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f6ac72ab-3b87-4dd6-970c-06f2646c738d tempest-VolumesCloneTest-1747485854 None] Created volume successfully. Nov 02 18:02:16 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 1073741824" returned: 0 in 0.460s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:16 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 Nov 02 18:02:16 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:16 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6" returned: 0 in 0.284s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d33cd34-c468-4492-8098-cc3a9baced68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f65649-ea48-4e6a-a153-c5254c9af1a6', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9710dc5c-3f1c-4b10-80ce-a28d0f55a868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Volume volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 (40f65649-ea48-4e6a-a153-c5254c9af1a6): created successfully Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9710dc5c-3f1c-4b10-80ce-a28d0f55a868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Flow 'volume_create_manager' (aea2fd7c-4c7f-4c88-94f8-e7fc8422bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d9a8c6e2-80d7-49dc-85a9-f7adab49fd13 tempest-CinderUnicodeTest-1252799091 None] Created volume successfully. Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Acquiring lock "cinder-204a1102-b521-47c8-a54e-440cd5456d01-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Lock "cinder-204a1102-b521-47c8-a54e-440cd5456d01-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Acquiring lock "cinder-quobyte-204a1102-b521-47c8-a54e-440cd5456d01" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-204a1102-b521-47c8-a54e-440cd5456d01" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[004b27ad-2b36-416f-aa0a-e1ff60172e48]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:17 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 Nov 02 18:02:17 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:17 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01" returned: 0 in 0.407s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:17 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01 Nov 02 18:02:17 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:17 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-204a1102-b521-47c8-a54e-440cd5456d01" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-204a1102-b521-47c8-a54e-440cd5456d01" released by "delete_volume" :: held 0.739s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Creating offline snapshot e12a1b0a-4719-4192-9d2b-4f2f5f13e534 of volume 40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Created reservations ['e2c04cc6-c46d-4325-8d42-a65033f0ee7e', '8346633e-c51d-4164-8ef6-81b0dd231436', 'a2fbeb0a-6e95-4e2c-88ce-639e0f62d8fe', 'b29f9c90-2484-4cde-be89-27c084e94a15'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[178e5812-33ff-4e05-99ea-d73f730a7e9d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:17 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 Nov 02 18:02:17 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:18 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:18 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Acquiring lock "cinder-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Lock "cinder-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Acquiring lock "cinder-quobyte-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:18 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6" returned: 0 in 0.540s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:18 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 1G Nov 02 18:02:18 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:18 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Deleted volume successfully. Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[febc5d06-1a49-49dd-a855-0cc157a95a5a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-576dc3dd-94c8-484f-96bd-6a5137449e5a tempest-VolumesCloneTest-1747485854 None] Lock "cinder-204a1102-b521-47c8-a54e-440cd5456d01-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:18 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c Nov 02 18:02:18 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:18 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" returned: 0 in 0.433s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:18 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 1G" returned: 0 in 0.540s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:18 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c Nov 02 18:02:18 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:18 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 Nov 02 18:02:18 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:19 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Lock "cinder-quobyte-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c" released by "delete_volume" :: held 0.816s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Created reservations ['c0d0af2b-9c1a-49ba-8cb5-89e735ebcb13', '1575946c-0f11-4b43-a9c2-09a69c974d19', '6c912228-2293-4026-879a-5b57a22763a8', '0c9dcc49-3dc6-43a0-9fbc-c92422f8c491'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:19 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534" returned: 0 in 0.379s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:19 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 is being set with open permissions: ugo+rw Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:19 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 Nov 02 18:02:19 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:19 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:19 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:19 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534" returned: 0 in 0.378s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:19 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.337s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Deleted volume successfully. Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-768dc474-548d-4f9d-ac67-1e0fc1837e67 tempest-VolumesCloneTest-1747485854 None] Lock "cinder-a6c49e03-70eb-4a4f-9b12-903ff52a0b0c-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:19 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info Nov 02 18:02:19 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:20 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info" returned: 0 in 0.304s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:20 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info is being set with open permissions: ugo+rw Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:20 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info Nov 02 18:02:20 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:20 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.info" returned: 0 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:20 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dfd7b84d-dd91-43ef-b39d-79490ed9d069 tempest-CinderUnicodeTest-1252799091 None] Create snapshot completed successfully Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-e12a1b0a-4719-4192-9d2b-4f2f5f13e534-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-e12a1b0a-4719-4192-9d2b-4f2f5f13e534-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-quobyte-40f65649-ea48-4e6a-a153-c5254c9af1a6" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-40f65649-ea48-4e6a-a153-c5254c9af1a6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-quobyte-e12a1b0a-4719-4192-9d2b-4f2f5f13e534" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-e12a1b0a-4719-4192-9d2b-4f2f5f13e534" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Deleting offline snapshot e12a1b0a-4719-4192-9d2b-4f2f5f13e534 of volume 40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] snapshot_file for this snap is: volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfb21d4-c41a-4e67-a08a-e30f8d4e0c75]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:21 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 Nov 02 18:02:21 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:21 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40f65649-ea48-4e6a-a153-c5254c9af1a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10b383f-394f-4bf9-8815-dc710b119a6c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:21 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 Nov 02 18:02:21 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:21 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6" returned: 0 in 0.408s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:22 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 Nov 02 18:02:22 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:22 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534" returned: 0 in 0.560s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:22 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534 Nov 02 18:02:22 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:22 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6.e12a1b0a-4719-4192-9d2b-4f2f5f13e534" returned: 0 in 0.316s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-e12a1b0a-4719-4192-9d2b-4f2f5f13e534" released by "_delete_snapshot" :: held 1.902s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-40f65649-ea48-4e6a-a153-c5254c9af1a6" released by "delete_snapshot" :: held 1.928s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Created reservations ['80a0c47a-3e1c-4e30-bbcf-4c10795800e5', '9e6dd15b-b59f-4785-b678-954e5eaeb1be', '68917403-f677-4997-9145-07f21ad841a9', '65fc4c98-3b0d-475d-a956-9b0f6ef5c5f3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Delete snapshot completed successfully. Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ac415978-7bc1-442c-99d7-ebb1e33122dc tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-e12a1b0a-4719-4192-9d2b-4f2f5f13e534-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Flow 'volume_create_manager' (03a75dac-afdb-43d6-8b84-9c4512079765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f412389f-f2b2-4bc0-9888-06a6142ae9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f412389f-f2b2-4bc0-9888-06a6142ae9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1243075428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3680ced8-d7be-4014-8dbc-225a77ae67a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a396c4daac1a4197af807630af2c7199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:23Z,use_quota=True,user_id='82aec14751494ae38735001a2efb2b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbd2c15-5dfd-45d3-b293-513d0c653e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbd2c15-5dfd-45d3-b293-513d0c653e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a97ab2-a23b-4b66-b935-229e59af2c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a97ab2-a23b-4b66-b935-229e59af2c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3680ced8-d7be-4014-8dbc-225a77ae67a0', 'volume_name': 'volume-3680ced8-d7be-4014-8dbc-225a77ae67a0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216c173-a625-4e3b-b3a6-f1f1969c04be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a216c173-a625-4e3b-b3a6-f1f1969c04be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d8586e-6a12-42da-a82f-22fde0a0d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:23 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Volume 3680ced8-d7be-4014-8dbc-225a77ae67a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3680ced8-d7be-4014-8dbc-225a77ae67a0', 'volume_size': 1} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1243075428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3680ced8-d7be-4014-8dbc-225a77ae67a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a396c4daac1a4197af807630af2c7199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:23Z,use_quota=True,user_id='82aec14751494ae38735001a2efb2b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Creating volume 3680ced8-d7be-4014-8dbc-225a77ae67a0 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:02:23 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:23 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 1073741824 Nov 02 18:02:23 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Flow 'volume_create_manager' (0b77d018-a3fd-4871-a0b2-5e16f1f1c784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3456af54-6011-4c16-bd5b-afb2b5c19199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3456af54-6011-4c16-bd5b-afb2b5c19199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1367897139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a396c4daac1a4197af807630af2c7199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:24Z,use_quota=True,user_id='82aec14751494ae38735001a2efb2b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a768750-28bb-4b5d-8a83-eedcd6ea8af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a768750-28bb-4b5d-8a83-eedcd6ea8af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098c7401-c21f-416c-b485-e231f65ab2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098c7401-c21f-416c-b485-e231f65ab2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4', 'volume_name': 'volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5def75-ee90-4d6f-bf31-201445662295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5def75-ee90-4d6f-bf31-201445662295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21d8674-93ea-4f4f-b802-10393aa9afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Volume ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4', 'volume_size': 1} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:24 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 1073741824" returned: 0 in 0.594s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-40f65649-ea48-4e6a-a153-c5254c9af1a6-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-40f65649-ea48-4e6a-a153-c5254c9af1a6-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:24 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 Nov 02 18:02:24 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-quobyte-40f65649-ea48-4e6a-a153-c5254c9af1a6" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-40f65649-ea48-4e6a-a153-c5254c9af1a6" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfac16-3cc4-4d01-882d-5e471f2a7f3d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:24 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 Nov 02 18:02:24 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:24 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0" returned: 0 in 0.344s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1367897139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a396c4daac1a4197af807630af2c7199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:24Z,use_quota=True,user_id='82aec14751494ae38735001a2efb2b76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Creating volume ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:02:24 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11d8586e-6a12-42da-a82f-22fde0a0d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3680ced8-d7be-4014-8dbc-225a77ae67a0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:24 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 1073741824 Nov 02 18:02:24 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1e96ea-32bd-478e-a0ce-0d3982b97f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Volume volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 (3680ced8-d7be-4014-8dbc-225a77ae67a0): created successfully Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1e96ea-32bd-478e-a0ce-0d3982b97f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Flow 'volume_create_manager' (03a75dac-afdb-43d6-8b84-9c4512079765) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-60c52d99-ef3a-4531-b74d-92b580885793 tempest-TestServerVolumeAttachmentScenario-266725784 None] Created volume successfully. Nov 02 18:02:24 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6" returned: 0 in 0.517s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:25 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6 Nov 02 18:02:25 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:25 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 1073741824" returned: 0 in 0.635s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Flow 'volume_create_manager' (d8539874-14c4-4b88-95b4-1185d48e1fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeced06-e963-464d-b7e7-2599b9a7af43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:25 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-40f65649-ea48-4e6a-a153-c5254c9af1a6" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeced06-e963-464d-b7e7-2599b9a7af43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1965018844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabf414e-3e75-471c-a703-96383702abee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12145e13eda4cdfb563844e7d840c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:25Z,use_quota=True,user_id='2d23a1c9f67f4e0c865e4391ca18066a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa28fae-a48d-4473-82f3-96ea0688c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa28fae-a48d-4473-82f3-96ea0688c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24dd76d-a30e-4e3e-9228-cddd63c0030a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24dd76d-a30e-4e3e-9228-cddd63c0030a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabf414e-3e75-471c-a703-96383702abee', 'volume_name': 'volume-fabf414e-3e75-471c-a703-96383702abee', 'volume_size': 2}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62c195a-3f6a-43a9-b1bc-024eccdd48dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62c195a-3f6a-43a9-b1bc-024eccdd48dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef73262-16f3-4d1a-8ef0-e42d42036510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Volume fabf414e-3e75-471c-a703-96383702abee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabf414e-3e75-471c-a703-96383702abee', 'volume_size': 2} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-40f65649-ea48-4e6a-a153-c5254c9af1a6" released by "delete_volume" :: held 1.002s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:25 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 Nov 02 18:02:25 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Created reservations ['e9c22a30-7526-454a-be48-76b29e3b3f0f', '61067510-1e52-434c-ae42-b23d34c6a709', 'c8d1c6d6-c910-4f4a-9fd9-5d9f3e947772', 'ecc22bb0-847d-4808-a305-10a9f2708663'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:25 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:25 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:25 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.279s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1965018844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabf414e-3e75-471c-a703-96383702abee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12145e13eda4cdfb563844e7d840c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:25Z,use_quota=True,user_id='2d23a1c9f67f4e0c865e4391ca18066a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Creating volume fabf414e-3e75-471c-a703-96383702abee {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:02:25 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee 2147483648 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21d8674-93ea-4f4f-b802-10393aa9afb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:25 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee 2147483648 Nov 02 18:02:25 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47593681-a608-4be8-b886-0d2f8382c86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:25 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Volume volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 (ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4): created successfully Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47593681-a608-4be8-b886-0d2f8382c86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Flow 'volume_create_manager' (0b77d018-a3fd-4871-a0b2-5e16f1f1c784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0f3f8c8a-e404-4009-979d-18a0e0bef44d tempest-TestServerVolumeAttachmentScenario-266725784 None] Created volume successfully. Nov 02 18:02:25 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.283s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Deleted volume successfully. Nov 02 18:02:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6890ed8a-0bce-43bc-942d-05a0fdef1a22 tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-40f65649-ea48-4e6a-a153-c5254c9af1a6-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:26 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee 2147483648" returned: 0 in 0.563s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:26 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee Nov 02 18:02:26 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-210808cd-239f-445b-a6f8-cd08fb5630f6-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-210808cd-239f-445b-a6f8-cd08fb5630f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:26 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "cinder-quobyte-210808cd-239f-445b-a6f8-cd08fb5630f6" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee" returned: 0 in 0.305s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef73262-16f3-4d1a-8ef0-e42d42036510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabf414e-3e75-471c-a703-96383702abee', 'volume_size': 2}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15e10e7-ab6f-4463-a4c0-5fc4eb3938d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-210808cd-239f-445b-a6f8-cd08fb5630f6" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:26 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Volume volume-fabf414e-3e75-471c-a703-96383702abee (fabf414e-3e75-471c-a703-96383702abee): created successfully Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15e10e7-ab6f-4463-a4c0-5fc4eb3938d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Flow 'volume_create_manager' (d8539874-14c4-4b88-95b4-1185d48e1fcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2647279-318c-4bf7-80fb-5af750981d09]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-aa6f7dba-6d1f-4363-9a39-d5321caa700b tempest-VolumesCloneNegativeTest-896072185 None] Created volume successfully. Nov 02 18:02:26 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 Nov 02 18:02:26 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:27 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6" returned: 0 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:27 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6 Nov 02 18:02:27 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:27 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Acquiring lock "cinder-fabf414e-3e75-471c-a703-96383702abee-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-210808cd-239f-445b-a6f8-cd08fb5630f6" returned: 0 in 0.317s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-quobyte-210808cd-239f-445b-a6f8-cd08fb5630f6" released by "delete_volume" :: held 0.783s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Lock "cinder-fabf414e-3e75-471c-a703-96383702abee-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Acquiring lock "cinder-quobyte-fabf414e-3e75-471c-a703-96383702abee" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Lock "cinder-quobyte-fabf414e-3e75-471c-a703-96383702abee" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Created reservations ['f01b47d2-bf53-431f-9e27-916df7fa968f', '9c3253c9-3d56-498d-89f8-9f2ce38a239b', '46820e1e-7363-487e-94de-d28cd878b326', '3a70e271-4823-4466-85d8-ff68b7fd304e'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b3503-01fa-45d1-a3d7-38fca51fb915]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:27 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee Nov 02 18:02:27 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:27 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:27 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:27 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.324s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:27 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Deleted volume successfully. Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a6b7b92-55e5-4521-8c89-a682de877f7f tempest-CinderUnicodeTest-1252799091 None] Lock "cinder-210808cd-239f-445b-a6f8-cd08fb5630f6-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:28 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee" returned: 0 in 0.512s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:28 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee Nov 02 18:02:28 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:28 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fabf414e-3e75-471c-a703-96383702abee" returned: 0 in 0.284s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Lock "cinder-quobyte-fabf414e-3e75-471c-a703-96383702abee" released by "delete_volume" :: held 0.859s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Created reservations ['9c8be46d-8a47-473b-8c48-7cee73b5d9bf', '71fba3dc-aefb-4e07-91fa-5a94b95391f6', '9938d027-f327-4c24-afae-557b947d69fb', '56daf238-c0ce-4573-8330-269541ac865d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:28 devstack sudo[103884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:28 devstack sudo[103884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:28 devstack sudo[103884]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.380s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Deleted volume successfully. Nov 02 18:02:28 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-63f7ef1d-d11a-4167-a6e8-96afde71abd4 tempest-VolumesCloneNegativeTest-896072185 None] Lock "cinder-fabf414e-3e75-471c-a703-96383702abee-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Flow 'volume_create_manager' (ce027e73-909a-4906-a0f7-986556c80a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b5a464-ea5e-4370-91fb-fd450da887a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b5a464-ea5e-4370-91fb-fd450da887a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-963145640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6649b214-8241-4c7d-83d5-b757a2447d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557ccc5a3fa5479baa7dab94d20d9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:34Z,use_quota=True,user_id='5bf9ed59257d437d91ef47f4a4423a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86371bfc-79fc-436d-8949-7e8c2d957047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86371bfc-79fc-436d-8949-7e8c2d957047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89136af6-2a24-4afc-8073-7bf11acd312e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89136af6-2a24-4afc-8073-7bf11acd312e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6649b214-8241-4c7d-83d5-b757a2447d6a', 'volume_name': 'volume-6649b214-8241-4c7d-83d5-b757a2447d6a', 'volume_size': 2}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e07f9cc-c133-403e-9583-3bd7a4fdee9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e07f9cc-c133-403e-9583-3bd7a4fdee9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3532df1a-b243-498f-a86f-4c2cec7906ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Volume 6649b214-8241-4c7d-83d5-b757a2447d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6649b214-8241-4c7d-83d5-b757a2447d6a', 'volume_size': 2} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-963145640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6649b214-8241-4c7d-83d5-b757a2447d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557ccc5a3fa5479baa7dab94d20d9699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:02:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:02:34Z,use_quota=True,user_id='5bf9ed59257d437d91ef47f4a4423a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Creating volume 6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:02:34 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:02:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a 2147483648 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:34 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a 2147483648 Nov 02 18:02:34 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:35 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a 2147483648" returned: 0 in 0.686s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:35 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a Nov 02 18:02:35 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:35 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a" returned: 0 in 0.288s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3532df1a-b243-498f-a86f-4c2cec7906ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6649b214-8241-4c7d-83d5-b757a2447d6a', 'volume_size': 2}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812f049a-0b40-484b-82ed-92d06fb5304d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:02:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Volume volume-6649b214-8241-4c7d-83d5-b757a2447d6a (6649b214-8241-4c7d-83d5-b757a2447d6a): created successfully Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812f049a-0b40-484b-82ed-92d06fb5304d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:02:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Flow 'volume_create_manager' (ce027e73-909a-4906-a0f7-986556c80a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:02:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-20b5762c-e5c9-476a-b7ab-b86f5a689d29 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Created volume successfully. Nov 02 18:02:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Creating offline snapshot 92455eea-8076-4a98-92d6-ce505e4c751c of volume 6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:02:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41c6838-4846-447b-a661-43212fa2744e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:36 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a Nov 02 18:02:36 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:37 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a" returned: 0 in 0.424s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c 2G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:37 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c 2G Nov 02 18:02:37 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:37 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c 2G" returned: 0 in 0.489s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6649b214-8241-4c7d-83d5-b757a2447d6a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:37 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6649b214-8241-4c7d-83d5-b757a2447d6a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c Nov 02 18:02:37 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:38 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6649b214-8241-4c7d-83d5-b757a2447d6a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c" returned: 0 in 0.335s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:38 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c is being set with open permissions: ugo+rw Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:38 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c Nov 02 18:02:38 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:38 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:38 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info Nov 02 18:02:38 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:38 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info" returned: 0 in 0.263s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:38 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info is being set with open permissions: ugo+rw Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:38 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info Nov 02 18:02:38 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:38 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.info" returned: 0 in 0.257s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:38 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=161,cinder:SELECT=109,cinder:INSERT=45,cinder:DELETE=12 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:02:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-142b5b59-83d4-4d27-bd9a-1aea5af1a9cf tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Create snapshot completed successfully Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "cinder-92455eea-8076-4a98-92d6-ce505e4c751c-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-92455eea-8076-4a98-92d6-ce505e4c751c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "cinder-quobyte-6649b214-8241-4c7d-83d5-b757a2447d6a" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-quobyte-6649b214-8241-4c7d-83d5-b757a2447d6a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "cinder-quobyte-92455eea-8076-4a98-92d6-ce505e4c751c" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-quobyte-92455eea-8076-4a98-92d6-ce505e4c751c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Deleting offline snapshot 92455eea-8076-4a98-92d6-ce505e4c751c of volume 6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] snapshot_file for this snap is: volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[de536705-b3df-4a9f-8cdd-738ef5b03b9b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:40 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c Nov 02 18:02:40 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:40 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6649b214-8241-4c7d-83d5-b757a2447d6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2425f1d-07dc-4410-92fe-71c1e356b7f1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:40 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a Nov 02 18:02:40 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:40 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a" returned: 0 in 0.383s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:40 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c Nov 02 18:02:40 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:41 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c" returned: 0 in 0.347s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:41 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c Nov 02 18:02:41 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:41 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a.92455eea-8076-4a98-92d6-ce505e4c751c" returned: 0 in 0.258s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-quobyte-92455eea-8076-4a98-92d6-ce505e4c751c" released by "_delete_snapshot" :: held 1.462s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-quobyte-6649b214-8241-4c7d-83d5-b757a2447d6a" released by "delete_snapshot" :: held 1.485s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Created reservations ['7563f0dc-44f7-43a1-82e1-56a66301c625', 'e0d081b8-7586-4cd4-9a63-a4cd691c4d03', 'ca266f0b-a13a-4ed2-8a9d-6c598d5fe47c', 'c17e26f4-eeab-409f-b670-f27c472b4030'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Delete snapshot completed successfully. Nov 02 18:02:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ca5f7576-f3ca-4963-b681-2c02dca48a7a tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-92455eea-8076-4a98-92d6-ce505e4c751c-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "cinder-6649b214-8241-4c7d-83d5-b757a2447d6a-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-6649b214-8241-4c7d-83d5-b757a2447d6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "cinder-quobyte-6649b214-8241-4c7d-83d5-b757a2447d6a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-quobyte-6649b214-8241-4c7d-83d5-b757a2447d6a" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a123d2-e865-4149-abae-d85f50854f02]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:42 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a Nov 02 18:02:42 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:42 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a" returned: 0 in 0.368s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:42 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a Nov 02 18:02:42 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:43 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6649b214-8241-4c7d-83d5-b757a2447d6a" returned: 0 in 0.246s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-quobyte-6649b214-8241-4c7d-83d5-b757a2447d6a" released by "delete_volume" :: held 0.676s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Created reservations ['f401ebfe-e560-4a00-b8c1-606af9b99456', '50fd6d67-9134-4b28-8c4a-afd6f8c1a500', 'e25395de-eda4-4595-915c-2870a53a5143', '72be2fc2-b5df-420c-aadc-99880b716ccf'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:43 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:43 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:43 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.259s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Deleted volume successfully. Nov 02 18:02:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-60085097-5b63-4273-9939-96e5fc9a9527 tempest-VolumesSnapshotNegativeTestJSON-1735988539 None] Lock "cinder-6649b214-8241-4c7d-83d5-b757a2447d6a-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:02:46 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:02:46 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:02:46 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:02:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:02:53 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=13 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:02:53 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=79,cinder:INSERT=22,cinder:SELECT=61,cinder:DELETE=7 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:02:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-30a35ed2-f259-4e43-aac7-84c66fb3ea90 req-63bc061a-9e7e-4317-80a1-a868b9f37e09 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:02:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-30a35ed2-f259-4e43-aac7-84c66fb3ea90 req-63bc061a-9e7e-4317-80a1-a868b9f37e09 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:02:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-30a35ed2-f259-4e43-aac7-84c66fb3ea90 req-63bc061a-9e7e-4317-80a1-a868b9f37e09 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:02:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-30a35ed2-f259-4e43-aac7-84c66fb3ea90 req-63bc061a-9e7e-4317-80a1-a868b9f37e09 tempest-TestServerVolumeAttachmentScenario-266725784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-3680ced8-d7be-4014-8dbc-225a77ae67a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c73fa9f-a8e9-478a-9696-c17fdbb14081', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 18:02:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-30a35ed2-f259-4e43-aac7-84c66fb3ea90 req-63bc061a-9e7e-4317-80a1-a868b9f37e09 tempest-TestServerVolumeAttachmentScenario-266725784 None] attachment_update completed successfully. Nov 02 18:03:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-6ce75c70-cfd7-4587-aae1-7c8c60c9b176 req-25416283-3369-471a-864b-0625e13d40db tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-6ce75c70-cfd7-4587-aae1-7c8c60c9b176 req-25416283-3369-471a-864b-0625e13d40db tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-6ce75c70-cfd7-4587-aae1-7c8c60c9b176 req-25416283-3369-471a-864b-0625e13d40db tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-6ce75c70-cfd7-4587-aae1-7c8c60c9b176 req-25416283-3369-471a-864b-0625e13d40db tempest-TestServerVolumeAttachmentScenario-266725784 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c314165-2753-4a52-98c5-b26990145ab2', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 18:03:04 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-6ce75c70-cfd7-4587-aae1-7c8c60c9b176 req-25416283-3369-471a-864b-0625e13d40db tempest-TestServerVolumeAttachmentScenario-266725784 None] attachment_update completed successfully. Nov 02 18:03:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-b7a2b036-70f0-4cb1-9278-1bf7eb63b139 req-531f31a5-84cb-4dbe-93b4-1aca292e90a8 tempest-TestServerVolumeAttachmentScenario-266725784 None] Terminate volume connection completed successfully. Nov 02 18:03:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-b7a2b036-70f0-4cb1-9278-1bf7eb63b139 req-531f31a5-84cb-4dbe-93b4-1aca292e90a8 tempest-TestServerVolumeAttachmentScenario-266725784 None] Deleting attachment 4c314165-2753-4a52-98c5-b26990145ab2. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 18:03:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-b0359404-3f27-4b11-aec0-5c11ba80b2a8 req-cd708fe0-aacc-4dc7-8ec5-9ef11222203f tempest-TestServerVolumeAttachmentScenario-266725784 None] Terminate volume connection completed successfully. Nov 02 18:03:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-b0359404-3f27-4b11-aec0-5c11ba80b2a8 req-cd708fe0-aacc-4dc7-8ec5-9ef11222203f tempest-TestServerVolumeAttachmentScenario-266725784 None] Deleting attachment 4c73fa9f-a8e9-478a-9696-c17fdbb14081. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 18:03:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "cinder-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "cinder-quobyte-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-quobyte-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:12 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aec0528-3804-4c99-a9b4-49270c97abbc]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:03:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:12 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 Nov 02 18:03:12 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:13 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4" returned: 0 in 0.392s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:13 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4 Nov 02 18:03:13 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:13 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-quobyte-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4" released by "delete_volume" :: held 0.815s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Created reservations ['aa2e6032-bb86-4b77-88c0-be4a8845c48d', 'b4f58379-3417-48e3-be47-cfcb48bbd574', 'ddace196-f9c0-4f48-8fee-7629a3a7f478', '80a0922b-2fa8-43ee-850f-e87b0d93277d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:13 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:03:13 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "cinder-3680ced8-d7be-4014-8dbc-225a77ae67a0-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-3680ced8-d7be-4014-8dbc-225a77ae67a0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "cinder-quobyte-3680ced8-d7be-4014-8dbc-225a77ae67a0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-quobyte-3680ced8-d7be-4014-8dbc-225a77ae67a0" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2653cf-b6c5-4a5b-b01c-cbdba147df86]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:13 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.282s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:03:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Deleted volume successfully. Nov 02 18:03:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-bffc603b-df9a-4e99-b047-5efe7b145954 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-ba6372eb-5ba0-4ffe-a0fd-2ec6fe2265e4-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:13 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 Nov 02 18:03:13 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:14 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0" returned: 0 in 0.404s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:14 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0 Nov 02 18:03:14 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:14 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-3680ced8-d7be-4014-8dbc-225a77ae67a0" returned: 0 in 0.258s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-quobyte-3680ced8-d7be-4014-8dbc-225a77ae67a0" released by "delete_volume" :: held 0.712s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Created reservations ['f43f6d35-a458-4b95-8ba0-29f010e84694', 'bc5dfa70-79b9-4a72-9c77-6dec644cc226', 'fdb91465-6a43-4378-a6fb-ea5e98a4dba0', 'baf29363-d629-4b2e-964b-a3b460fbbc20'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:14 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:03:14 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:14 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:03:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Deleted volume successfully. Nov 02 18:03:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b805a73b-5269-44a3-a95d-80595264ba13 tempest-TestServerVolumeAttachmentScenario-266725784 None] Lock "cinder-3680ced8-d7be-4014-8dbc-225a77ae67a0-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:24 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:03:24 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Flow 'volume_create_manager' (1782f215-925b-41e3-95e1-8fe8583e017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd36eff-2a9b-4c48-adc5-d5add57861e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd36eff-2a9b-4c48-adc5-d5add57861e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332407791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf130de-a4ae-48d5-95ca-5e94b8f13933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e2a7f0f084d2f816576a4fa5f2541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:03:29Z,use_quota=True,user_id='3591bf51acb24776ab47dbf3b61f9cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d5cfbe-f884-4f32-9e3c-b50a2e3c9ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d5cfbe-f884-4f32-9e3c-b50a2e3c9ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe89641-162c-4128-8159-e6a9225bf31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe89641-162c-4128-8159-e6a9225bf31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf130de-a4ae-48d5-95ca-5e94b8f13933', 'volume_name': 'volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa064f9-e2bb-429f-8147-80388744a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa064f9-e2bb-429f-8147-80388744a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9810a6d2-3c58-445d-9b1f-43f1862e34df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Volume ccf130de-a4ae-48d5-95ca-5e94b8f13933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933', 'volume_size': 1} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:03:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1332407791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf130de-a4ae-48d5-95ca-5e94b8f13933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e2a7f0f084d2f816576a4fa5f2541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:03:29Z,use_quota=True,user_id='3591bf51acb24776ab47dbf3b61f9cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Creating volume ccf130de-a4ae-48d5-95ca-5e94b8f13933 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:03:28 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:03:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:28 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 1073741824 Nov 02 18:03:28 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:29 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 1073741824" returned: 0 in 0.454s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:29 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 Nov 02 18:03:29 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:29 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9810a6d2-3c58-445d-9b1f-43f1862e34df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64da566-f540-4cd1-acc3-1807290ef63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Volume volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 (ccf130de-a4ae-48d5-95ca-5e94b8f13933): created successfully Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64da566-f540-4cd1-acc3-1807290ef63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Flow 'volume_create_manager' (1782f215-925b-41e3-95e1-8fe8583e017e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dda07409-c63e-4590-9f32-1100a9818aa5 tempest-ProjectReaderTests-1132116006 None] Created volume successfully. Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Acquiring lock "cinder-ccf130de-a4ae-48d5-95ca-5e94b8f13933-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Lock "cinder-ccf130de-a4ae-48d5-95ca-5e94b8f13933-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Acquiring lock "cinder-quobyte-ccf130de-a4ae-48d5-95ca-5e94b8f13933" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Lock "cinder-quobyte-ccf130de-a4ae-48d5-95ca-5e94b8f13933" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efb6189-3d80-4ac3-8e0a-36804ee42fb6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:03:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:30 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 Nov 02 18:03:30 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:30 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933" returned: 0 in 0.368s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:30 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933 Nov 02 18:03:30 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:30 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ccf130de-a4ae-48d5-95ca-5e94b8f13933" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Lock "cinder-quobyte-ccf130de-a4ae-48d5-95ca-5e94b8f13933" released by "delete_volume" :: held 0.647s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Created reservations ['72d7add8-35ea-4997-9154-3942a8d1e10f', 'b297ddf2-680d-45a7-92fb-17e006c2fe63', 'e0d58486-3a59-4c07-99cf-55a1fcb9b65c', 'c20d9e6a-fd75-4fd9-85cb-8e860d3c48d5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:30 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:03:30 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:30 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:03:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Deleted volume successfully. Nov 02 18:03:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-879cb2a7-0ec9-4bfd-9084-7fa4954a58ae tempest-ProjectReaderTests-1132116006 None] Lock "cinder-ccf130de-a4ae-48d5-95ca-5e94b8f13933-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Flow 'volume_create_manager' (1ddfe757-984a-4e80-9686-f16881a5f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba189c15-7921-44aa-8b50-c258a7b46854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba189c15-7921-44aa-8b50-c258a7b46854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708023802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790633db-5e65-4bfe-baee-5ad06ce4bc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e2a7f0f084d2f816576a4fa5f2541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:03:31Z,use_quota=True,user_id='3591bf51acb24776ab47dbf3b61f9cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50b9b95-aba1-4899-95fd-08d3e0509714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50b9b95-aba1-4899-95fd-08d3e0509714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8adcdac-5619-4e17-ba7d-9e2978194cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8adcdac-5619-4e17-ba7d-9e2978194cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790633db-5e65-4bfe-baee-5ad06ce4bc10', 'volume_name': 'volume-790633db-5e65-4bfe-baee-5ad06ce4bc10', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f31b1f2-62d2-4ec5-bc40-e2cfa8a72b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f31b1f2-62d2-4ec5-bc40-e2cfa8a72b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d52131f-41a9-4b3f-91f5-9f6188b18473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:31 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Volume 790633db-5e65-4bfe-baee-5ad06ce4bc10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790633db-5e65-4bfe-baee-5ad06ce4bc10', 'volume_size': 1} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-708023802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790633db-5e65-4bfe-baee-5ad06ce4bc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e2a7f0f084d2f816576a4fa5f2541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:03:31Z,use_quota=True,user_id='3591bf51acb24776ab47dbf3b61f9cb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Creating volume 790633db-5e65-4bfe-baee-5ad06ce4bc10 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:03:31 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:31 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 1073741824 Nov 02 18:03:31 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:31 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 1073741824" returned: 0 in 0.397s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:31 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 Nov 02 18:03:31 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:32 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10" returned: 0 in 0.248s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d52131f-41a9-4b3f-91f5-9f6188b18473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790633db-5e65-4bfe-baee-5ad06ce4bc10', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043ed794-5bee-4589-b8ff-528ad6bdd409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:32 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Volume volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 (790633db-5e65-4bfe-baee-5ad06ce4bc10): created successfully Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043ed794-5bee-4589-b8ff-528ad6bdd409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Flow 'volume_create_manager' (1ddfe757-984a-4e80-9686-f16881a5f172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9695819b-c97d-4d63-af8b-33c8c72eaf5b tempest-ProjectReaderTests-1132116006 None] Created volume successfully. Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Acquiring lock "cinder-790633db-5e65-4bfe-baee-5ad06ce4bc10-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Lock "cinder-790633db-5e65-4bfe-baee-5ad06ce4bc10-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Acquiring lock "cinder-quobyte-790633db-5e65-4bfe-baee-5ad06ce4bc10" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Lock "cinder-quobyte-790633db-5e65-4bfe-baee-5ad06ce4bc10" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2b77d-0708-4a14-ac7d-5c9686b903cb]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:32 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 Nov 02 18:03:32 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:32 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:32 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10 Nov 02 18:03:32 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:33 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-790633db-5e65-4bfe-baee-5ad06ce4bc10" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Lock "cinder-quobyte-790633db-5e65-4bfe-baee-5ad06ce4bc10" released by "delete_volume" :: held 0.658s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Created reservations ['6a3d2353-4601-4588-9a3e-bf08a0b48877', '6bec3656-b3ab-41a5-9547-7885fa83e4c6', '7fbce400-1413-46ab-8c34-752565c27cf3', '2199a453-6662-4bcd-8e96-3360b776d6e6'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:33 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:03:33 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:33 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:03:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Deleted volume successfully. Nov 02 18:03:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-77f1a078-636f-48a7-a66c-88b009ae2f03 tempest-ProjectReaderTests-1132116006 None] Lock "cinder-790633db-5e65-4bfe-baee-5ad06ce4bc10-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Flow 'volume_create_manager' (96bfbed8-27cd-40cc-a747-5423adfb638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144aeb2b-122c-43fe-a8d0-8c57daa28253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144aeb2b-122c-43fe-a8d0-8c57daa28253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1204456633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343a01bd-5529-4007-bdd0-d0551af37545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923602537aa243a18ac7023ab6416b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:03:39Z,use_quota=True,user_id='67ce477b212a4504b432dc723b2c70f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823b94aa-f69b-4e2a-812c-af8634848614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823b94aa-f69b-4e2a-812c-af8634848614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bad5fdb-1882-43c2-8fa3-8d4530e7bc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bad5fdb-1882-43c2-8fa3-8d4530e7bc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343a01bd-5529-4007-bdd0-d0551af37545', 'volume_name': 'volume-343a01bd-5529-4007-bdd0-d0551af37545', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5362c0bf-f478-40aa-a886-a175d303d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5362c0bf-f478-40aa-a886-a175d303d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f1b0dc-6e2e-4c28-8d8a-7220bb639999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:39 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Volume 343a01bd-5529-4007-bdd0-d0551af37545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343a01bd-5529-4007-bdd0-d0551af37545', 'volume_size': 1} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1204456633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343a01bd-5529-4007-bdd0-d0551af37545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923602537aa243a18ac7023ab6416b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:03:39Z,use_quota=True,user_id='67ce477b212a4504b432dc723b2c70f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Creating volume 343a01bd-5529-4007-bdd0-d0551af37545 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:03:39 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:03:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:39 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 1073741824 Nov 02 18:03:39 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:40 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 1073741824" returned: 0 in 0.419s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:40 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 Nov 02 18:03:40 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:40 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545" returned: 0 in 0.241s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f1b0dc-6e2e-4c28-8d8a-7220bb639999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343a01bd-5529-4007-bdd0-d0551af37545', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024e2685-3e5e-455d-b6b7-13a5c3899816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Volume volume-343a01bd-5529-4007-bdd0-d0551af37545 (343a01bd-5529-4007-bdd0-d0551af37545): created successfully Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024e2685-3e5e-455d-b6b7-13a5c3899816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Flow 'volume_create_manager' (96bfbed8-27cd-40cc-a747-5423adfb638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ab8e7861-ab55-4d22-987e-2f51ffaba7bf tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Created volume successfully. Nov 02 18:03:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ad5a2b5b-ff81-4471-84f9-1670b9df13e0 req-2526df26-c3f0-4eb2-ad94-2e871c26e943 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ad5a2b5b-ff81-4471-84f9-1670b9df13e0 req-2526df26-c3f0-4eb2-ad94-2e871c26e943 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [req-ad5a2b5b-ff81-4471-84f9-1670b9df13e0 req-2526df26-c3f0-4eb2-ad94-2e871c26e943 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-ad5a2b5b-ff81-4471-84f9-1670b9df13e0 req-2526df26-c3f0-4eb2-ad94-2e871c26e943 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6', 'name': 'volume-343a01bd-5529-4007-bdd0-d0551af37545', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5358bafe-5c39-4a09-9692-48a6c8595815', 'enforce_multipath': True} {{(pid=86585) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 18:03:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-ad5a2b5b-ff81-4471-84f9-1670b9df13e0 req-2526df26-c3f0-4eb2-ad94-2e871c26e943 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] attachment_update completed successfully. Nov 02 18:03:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [req-a0aeca83-99d9-41c5-9731-e0edbe647db2 req-91d27f8f-24fe-45f5-984f-ae0a6b4b76d2 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Terminate volume connection completed successfully. Nov 02 18:03:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [req-a0aeca83-99d9-41c5-9731-e0edbe647db2 req-91d27f8f-24fe-45f5-984f-ae0a6b4b76d2 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Deleting attachment 5358bafe-5c39-4a09-9692-48a6c8595815. {{(pid=86585) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Acquiring lock "cinder-343a01bd-5529-4007-bdd0-d0551af37545-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "cinder-343a01bd-5529-4007-bdd0-d0551af37545-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Acquiring lock "cinder-quobyte-343a01bd-5529-4007-bdd0-d0551af37545" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "cinder-quobyte-343a01bd-5529-4007-bdd0-d0551af37545" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7c947a-a513-46cf-aea9-7e524493025b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:44 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 Nov 02 18:03:44 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:44 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545" returned: 0 in 0.366s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:44 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545 Nov 02 18:03:44 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:44 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-343a01bd-5529-4007-bdd0-d0551af37545" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "cinder-quobyte-343a01bd-5529-4007-bdd0-d0551af37545" released by "delete_volume" :: held 0.662s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Created reservations ['ca744d6a-592a-46b3-979f-f39ab771a01a', 'ccfaab7c-7cb4-4d12-9ed5-7763912a25b2', '3d9ccbfb-d16e-4357-a283-4bc15e237f0f', 'e88ca36b-8856-48cb-9af0-db7dc0609a1a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:45 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:03:45 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:45 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:03:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Deleted volume successfully. Nov 02 18:03:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-712d0bc2-9479-451b-b851-5853679f9e67 tempest-TestServerVolumeAttachScenarioOldVersion-362161096 None] Lock "cinder-343a01bd-5529-4007-bdd0-d0551af37545-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:46 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:03:46 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:03:46 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:03:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:03:55 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=34,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:03:55 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=37,cinder:SELECT=23,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (644454e5-e5f2-499c-8411-4d520fb212bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3947fd-b80d-4ef5-b6d8-5f75c1613d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3947fd-b80d-4ef5-b6d8-5f75c1613d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326207858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e985ee56-0ad3-4383-a369-fd04fa445a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:00Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6555c7b8-52ee-45d7-b410-9c3c9d14a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6555c7b8-52ee-45d7-b410-9c3c9d14a83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837bd50c-4182-4fc4-8799-13da89f01589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (837bd50c-4182-4fc4-8799-13da89f01589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e985ee56-0ad3-4383-a369-fd04fa445a29', 'volume_name': 'volume-e985ee56-0ad3-4383-a369-fd04fa445a29', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fca75ff-8b76-4d44-9445-b8bcb3e08d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fca75ff-8b76-4d44-9445-b8bcb3e08d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdf078e-8e8b-4f5f-ab5f-2f5ad3cd4c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:03:59 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Volume e985ee56-0ad3-4383-a369-fd04fa445a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e985ee56-0ad3-4383-a369-fd04fa445a29', 'volume_size': 1} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326207858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e985ee56-0ad3-4383-a369-fd04fa445a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:00Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Creating volume e985ee56-0ad3-4383-a369-fd04fa445a29 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:03:59 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:03:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:03:59 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 1073741824 Nov 02 18:03:59 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (1b7baa46-b469-4f8a-a77e-23bc720488d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d3134-2473-430d-a892-4ce6010ca1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (388d3134-2473-430d-a892-4ce6010ca1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065551480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fe3283-8b83-4221-9afe-530404b334bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:00Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e570ee0a-e509-4aeb-a55d-d7c059ef7c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e570ee0a-e509-4aeb-a55d-d7c059ef7c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372c5f3a-90df-4917-a2c4-72ad40c2ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372c5f3a-90df-4917-a2c4-72ad40c2ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4fe3283-8b83-4221-9afe-530404b334bf', 'volume_name': 'volume-a4fe3283-8b83-4221-9afe-530404b334bf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586e92b7-7cdc-4b56-ba97-c12ef5fd4083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (586e92b7-7cdc-4b56-ba97-c12ef5fd4083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa66cb5-b618-4632-8c39-f859cdbba5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Volume a4fe3283-8b83-4221-9afe-530404b334bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4fe3283-8b83-4221-9afe-530404b334bf', 'volume_size': 1} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:00 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 1073741824" returned: 0 in 0.494s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:00 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 Nov 02 18:04:00 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (828659cb-fbcd-4953-9064-3bc6711d2b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cdb0d5-a33a-4718-bb6d-3ebe4b4f336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cdb0d5-a33a-4718-bb6d-3ebe4b4f336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-572440246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adad507f-9f53-48d3-aa62-c9dc57ec2320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:01Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84869526-0548-4951-b063-bdecc8c67412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84869526-0548-4951-b063-bdecc8c67412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738010fc-f63d-47b3-818d-949d63057b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738010fc-f63d-47b3-818d-949d63057b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adad507f-9f53-48d3-aa62-c9dc57ec2320', 'volume_name': 'volume-adad507f-9f53-48d3-aa62-c9dc57ec2320', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4769fe1a-0caa-4b41-9aae-77982000315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4769fe1a-0caa-4b41-9aae-77982000315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95196463-5db0-427c-b2e3-ccae48590320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Volume adad507f-9f53-48d3-aa62-c9dc57ec2320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adad507f-9f53-48d3-aa62-c9dc57ec2320', 'volume_size': 1} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:00 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1065551480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4fe3283-8b83-4221-9afe-530404b334bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:00Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Creating volume a4fe3283-8b83-4221-9afe-530404b334bf {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:00 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:00 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf 1073741824 Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdf078e-8e8b-4f5f-ab5f-2f5ad3cd4c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e985ee56-0ad3-4383-a369-fd04fa445a29', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bb1e06-dbba-48e0-825d-9707d9955279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Volume volume-e985ee56-0ad3-4383-a369-fd04fa445a29 (e985ee56-0ad3-4383-a369-fd04fa445a29): created successfully Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bb1e06-dbba-48e0-825d-9707d9955279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (644454e5-e5f2-499c-8411-4d520fb212bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca79c0e0-68e7-4bdb-8ca2-cd573dbb339a tempest-CreateVolumesFromImageTest-755449209 None] Created volume successfully. Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (ac2d67b7-6ea4-4e0c-a45d-5a86b316fd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5ba793-a395-43b4-8a4d-288cea3522d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5ba793-a395-43b4-8a4d-288cea3522d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372682535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dce1b5f-068a-4283-b818-0b5281fd1121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:01Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21ef094-d4f9-4cb1-887b-76cb4f604ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21ef094-d4f9-4cb1-887b-76cb4f604ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5463b030-9923-45d6-950b-3b910b14677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5463b030-9923-45d6-950b-3b910b14677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dce1b5f-068a-4283-b818-0b5281fd1121', 'volume_name': 'volume-8dce1b5f-068a-4283-b818-0b5281fd1121', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8175c7fa-8433-4fa7-a0dc-46ffa9d61ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8175c7fa-8433-4fa7-a0dc-46ffa9d61ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155ac064-66dc-4b55-9e74-300862525d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Volume 8dce1b5f-068a-4283-b818-0b5281fd1121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dce1b5f-068a-4283-b818-0b5281fd1121', 'volume_size': 1} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:01 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf 1073741824" returned: 0 in 0.523s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:01 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf Nov 02 18:04:01 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (f13e58ba-f534-4527-b5c8-62b61565e337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559527c4-76d3-4be7-b211-3a2518676887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559527c4-76d3-4be7-b211-3a2518676887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875673052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71b08e9-f955-4782-bb33-2fa317188acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:01Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b28c081-7975-4a23-977a-2c9a2dd8625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b28c081-7975-4a23-977a-2c9a2dd8625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9b8b79-46c2-48a3-89d4-c29f7e637b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9b8b79-46c2-48a3-89d4-c29f7e637b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71b08e9-f955-4782-bb33-2fa317188acc', 'volume_name': 'volume-e71b08e9-f955-4782-bb33-2fa317188acc', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34df240-4b9b-4fae-82b2-6be84c5badb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34df240-4b9b-4fae-82b2-6be84c5badb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db4c33b-375f-4ee1-a906-fe2387c5168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Volume e71b08e9-f955-4782-bb33-2fa317188acc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71b08e9-f955-4782-bb33-2fa317188acc', 'volume_size': 1} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:01 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf" returned: 0 in 0.241s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-572440246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adad507f-9f53-48d3-aa62-c9dc57ec2320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:01Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Creating volume adad507f-9f53-48d3-aa62-c9dc57ec2320 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:01 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa66cb5-b618-4632-8c39-f859cdbba5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4fe3283-8b83-4221-9afe-530404b334bf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 1073741824 Nov 02 18:04:01 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad86b60-0e2d-4e12-bf39-a42981973d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Volume volume-a4fe3283-8b83-4221-9afe-530404b334bf (a4fe3283-8b83-4221-9afe-530404b334bf): created successfully Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ad86b60-0e2d-4e12-bf39-a42981973d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (1b7baa46-b469-4f8a-a77e-23bc720488d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-bc3d7d35-0b59-45bc-8134-ee6e1ab89410 tempest-CreateVolumesFromImageTest-755449209 None] Created volume successfully. Nov 02 18:04:02 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 1073741824" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:02 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 Nov 02 18:04:02 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:02 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.113s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1372682535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dce1b5f-068a-4283-b818-0b5281fd1121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:01Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Creating volume 8dce1b5f-068a-4283-b818-0b5281fd1121 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:02 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95196463-5db0-427c-b2e3-ccae48590320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adad507f-9f53-48d3-aa62-c9dc57ec2320', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee5be4b-e603-4a6d-8ac7-d150a082fb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:02 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 1073741824 Nov 02 18:04:02 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Volume volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 (adad507f-9f53-48d3-aa62-c9dc57ec2320): created successfully Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee5be4b-e603-4a6d-8ac7-d150a082fb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (828659cb-fbcd-4953-9064-3bc6711d2b8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8b73c0e2-60cd-44c2-8cf7-a598c6f0af4b tempest-CreateVolumesFromImageTest-755449209 None] Created volume successfully. Nov 02 18:04:02 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 1073741824" returned: 0 in 0.417s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:02 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 Nov 02 18:04:02 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:02 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121" returned: 0 in 0.231s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875673052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71b08e9-f955-4782-bb33-2fa317188acc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd2841d732a462896dd0f3f40261dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:01Z,use_quota=True,user_id='9ebad82337a740be8edbf6e117b4c946',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Creating volume e71b08e9-f955-4782-bb33-2fa317188acc {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:02 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (155ac064-66dc-4b55-9e74-300862525d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dce1b5f-068a-4283-b818-0b5281fd1121', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51d7561-9cd4-46b5-a235-724f0190520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:03 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc 1073741824 Nov 02 18:04:03 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:03 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Volume volume-8dce1b5f-068a-4283-b818-0b5281fd1121 (8dce1b5f-068a-4283-b818-0b5281fd1121): created successfully Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51d7561-9cd4-46b5-a235-724f0190520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (ac2d67b7-6ea4-4e0c-a45d-5a86b316fd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2d4c2e4d-7b8f-41f9-bb04-edd1517edd64 tempest-CreateVolumesFromImageTest-755449209 None] Created volume successfully. Nov 02 18:04:03 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc 1073741824" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:03 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc Nov 02 18:04:03 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:03 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db4c33b-375f-4ee1-a906-fe2387c5168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71b08e9-f955-4782-bb33-2fa317188acc', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa1bacf-3655-4a53-8db5-619d1753fa5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:03 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Volume volume-e71b08e9-f955-4782-bb33-2fa317188acc (e71b08e9-f955-4782-bb33-2fa317188acc): created successfully Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa1bacf-3655-4a53-8db5-619d1753fa5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Flow 'volume_create_manager' (f13e58ba-f534-4527-b5c8-62b61565e337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-08721338-048d-47a4-90e3-88257e8c0cfa tempest-CreateVolumesFromImageTest-755449209 None] Created volume successfully. Nov 02 18:04:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-e71b08e9-f955-4782-bb33-2fa317188acc-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-e71b08e9-f955-4782-bb33-2fa317188acc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-quobyte-e71b08e9-f955-4782-bb33-2fa317188acc" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-e71b08e9-f955-4782-bb33-2fa317188acc" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbf13b8-4b2e-43bf-a9ba-8ad0295a228d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:04 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc Nov 02 18:04:04 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:05 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:05 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc Nov 02 18:04:05 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:05 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e71b08e9-f955-4782-bb33-2fa317188acc" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-e71b08e9-f955-4782-bb33-2fa317188acc" released by "delete_volume" :: held 0.634s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Created reservations ['c5906328-9ad9-4535-a651-91883063ac4d', '6659b147-7de7-4251-8b13-5ca10a36cc43', '1d9794db-4537-45b6-996a-e1af50ce3a1e', 'e33b6738-3821-40d4-8d6a-e24b41528dd6'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:05 devstack sudo[105349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:05 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:05 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.237s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Deleted volume successfully. Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-55c54539-f1a5-44d4-aad7-40feac3410ef tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-e71b08e9-f955-4782-bb33-2fa317188acc-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-8dce1b5f-068a-4283-b818-0b5281fd1121-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-8dce1b5f-068a-4283-b818-0b5281fd1121-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-quobyte-8dce1b5f-068a-4283-b818-0b5281fd1121" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-8dce1b5f-068a-4283-b818-0b5281fd1121" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[42492ee0-3907-4b97-b48c-16d9c2bed148]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:06 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 Nov 02 18:04:06 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:06 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:06 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121 Nov 02 18:04:06 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:06 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8dce1b5f-068a-4283-b818-0b5281fd1121" returned: 0 in 0.240s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-8dce1b5f-068a-4283-b818-0b5281fd1121" released by "delete_volume" :: held 0.635s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Created reservations ['150e3af8-26d2-45f6-826b-b0ca2573d21a', '4c1a31d8-809c-4fee-921c-c83b1e9d3c25', 'd6ff797e-6dbd-4c15-b225-879e53fde7de', '358fd446-fc32-4d00-8d49-f27ce5935fba'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:06 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:06 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:06 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.234s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Deleted volume successfully. Nov 02 18:04:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-efd57c9f-296a-4c8e-a30b-feb14442d616 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-8dce1b5f-068a-4283-b818-0b5281fd1121-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-adad507f-9f53-48d3-aa62-c9dc57ec2320-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-adad507f-9f53-48d3-aa62-c9dc57ec2320-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-quobyte-adad507f-9f53-48d3-aa62-c9dc57ec2320" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-adad507f-9f53-48d3-aa62-c9dc57ec2320" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[756dc652-c2bf-4426-81f1-6e9e205250ab]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:07 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 Nov 02 18:04:07 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:07 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320" returned: 0 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:07 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320 Nov 02 18:04:07 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:07 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-adad507f-9f53-48d3-aa62-c9dc57ec2320" returned: 0 in 0.234s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-adad507f-9f53-48d3-aa62-c9dc57ec2320" released by "delete_volume" :: held 0.626s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Created reservations ['9e5acd6a-a518-42c9-9397-12aa8f72d13c', '0d22c307-8c44-484b-923d-ed111ffca93b', '1b95162a-d281-48d3-87ad-5bf7a21c5d04', '605b4314-19cc-4e36-ba59-feb90123a6fc'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:07 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:07 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:08 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.256s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Deleted volume successfully. Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-057c16f8-e150-4a37-806a-726a7f116ab9 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-adad507f-9f53-48d3-aa62-c9dc57ec2320-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-a4fe3283-8b83-4221-9afe-530404b334bf-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-a4fe3283-8b83-4221-9afe-530404b334bf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-quobyte-a4fe3283-8b83-4221-9afe-530404b334bf" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-a4fe3283-8b83-4221-9afe-530404b334bf" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5990ea14-553f-43b8-87a1-8728d78c9b80]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:08 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf Nov 02 18:04:08 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:08 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf" returned: 0 in 0.353s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:08 devstack sudo[105380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf Nov 02 18:04:08 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:08 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a4fe3283-8b83-4221-9afe-530404b334bf" returned: 0 in 0.235s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-a4fe3283-8b83-4221-9afe-530404b334bf" released by "delete_volume" :: held 0.628s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:08 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Created reservations ['4a7b79ba-9c04-4de8-8de1-b9a0ba9e4296', 'a34d900d-7a4b-4a7e-a3f3-3961f09f8780', '2c0318d5-836e-4d13-af05-977319b210c4', '3af2558e-db06-4d3d-95c7-cdab071ed2a5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:09 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:09 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:09 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.256s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:09 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Deleted volume successfully. Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-030c1f7d-b611-4d98-b2f9-5f75c4062461 tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-a4fe3283-8b83-4221-9afe-530404b334bf-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-e985ee56-0ad3-4383-a369-fd04fa445a29-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-e985ee56-0ad3-4383-a369-fd04fa445a29-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "cinder-quobyte-e985ee56-0ad3-4383-a369-fd04fa445a29" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-e985ee56-0ad3-4383-a369-fd04fa445a29" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da6cad8-ee05-44f1-889f-0f0a96884565]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:09 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 Nov 02 18:04:09 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:09 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29" returned: 0 in 0.348s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:09 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29 Nov 02 18:04:09 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:10 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e985ee56-0ad3-4383-a369-fd04fa445a29" returned: 0 in 0.245s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-quobyte-e985ee56-0ad3-4383-a369-fd04fa445a29" released by "delete_volume" :: held 0.633s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Created reservations ['2c3af7c8-9a4d-4adb-95ef-3eb436b2fb00', '53f45d7b-479d-41b7-80a7-122fe15ae9c4', '0d68f164-d52b-4d4f-8806-0d922147468a', '97536185-5f63-4730-bd6d-04cbf8a02a9d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:10 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:10 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:10 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.250s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Deleted volume successfully. Nov 02 18:04:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fcd791a0-b781-455c-8bce-9757446bc22b tempest-CreateVolumesFromImageTest-755449209 None] Lock "cinder-e985ee56-0ad3-4383-a369-fd04fa445a29-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (da299226-05d4-4aeb-9efc-28f9eb421531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8b6b09-fd56-49da-a823-65ea6c190ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e8b6b09-fd56-49da-a823-65ea6c190ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931960169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e34cb77-73a7-476c-8722-a372f4d6b002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:13Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4806e69f-b11a-4fe7-8880-584347bd2e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4806e69f-b11a-4fe7-8880-584347bd2e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af109d23-d074-46df-b50c-ccd796e987cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af109d23-d074-46df-b50c-ccd796e987cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e34cb77-73a7-476c-8722-a372f4d6b002', 'volume_name': 'volume-5e34cb77-73a7-476c-8722-a372f4d6b002', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f372c2-74d4-4776-a736-8152f3c545f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f372c2-74d4-4776-a736-8152f3c545f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc9edf8-c21f-43f1-bb6f-bbe87cd7a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume 5e34cb77-73a7-476c-8722-a372f4d6b002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e34cb77-73a7-476c-8722-a372f4d6b002', 'volume_size': 1} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931960169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e34cb77-73a7-476c-8722-a372f4d6b002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:13Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Creating volume 5e34cb77-73a7-476c-8722-a372f4d6b002 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:13 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:13 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 1073741824 Nov 02 18:04:13 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:13 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 1073741824" returned: 0 in 0.419s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:13 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 Nov 02 18:04:13 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:13 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002" returned: 0 in 0.237s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc9edf8-c21f-43f1-bb6f-bbe87cd7a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e34cb77-73a7-476c-8722-a372f4d6b002', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712b5417-dc06-430d-b212-33f6d1aa4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume volume-5e34cb77-73a7-476c-8722-a372f4d6b002 (5e34cb77-73a7-476c-8722-a372f4d6b002): created successfully Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712b5417-dc06-430d-b212-33f6d1aa4a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (da299226-05d4-4aeb-9efc-28f9eb421531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-604654a0-9dad-4b46-a63f-5a9d8fd204d9 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created volume successfully. Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (3d405cf7-69d6-416e-ae0d-a4ae24d9a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a430f98-c3bb-443f-834e-61ea61da83e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a430f98-c3bb-443f-834e-61ea61da83e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610395308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e17c015-0dff-4c9e-8142-9a68787a9cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:15Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e14adb5-ac33-4a39-9b61-a3e2c946b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e14adb5-ac33-4a39-9b61-a3e2c946b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b346cb0b-5afa-46c2-97e8-787e70036779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b346cb0b-5afa-46c2-97e8-787e70036779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e17c015-0dff-4c9e-8142-9a68787a9cdb', 'volume_name': 'volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ec9716-6927-4e1b-a505-25b2daacf848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6ec9716-6927-4e1b-a505-25b2daacf848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f427af-9614-47ae-ac9f-d963ff6ecc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:14 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume 4e17c015-0dff-4c9e-8142-9a68787a9cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb', 'volume_size': 1} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-610395308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e17c015-0dff-4c9e-8142-9a68787a9cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:15Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Creating volume 4e17c015-0dff-4c9e-8142-9a68787a9cdb {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:14 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:14 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb 1073741824 Nov 02 18:04:14 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (5a68679c-1135-4262-8718-9abc13a7db30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b263f6-125a-4e55-9601-66e37c755d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b263f6-125a-4e55-9601-66e37c755d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801795283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8bbacc-81c8-4c24-90f4-3ab80eab6669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:15Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d3c4da-58cd-495d-ae70-1814510383bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d3c4da-58cd-495d-ae70-1814510383bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed467e4e-26f4-441f-9be7-fff7b0cf5d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed467e4e-26f4-441f-9be7-fff7b0cf5d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8bbacc-81c8-4c24-90f4-3ab80eab6669', 'volume_name': 'volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16be798f-cc3d-43a0-ba64-1e0d6a9d4f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16be798f-cc3d-43a0-ba64-1e0d6a9d4f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7775d4-851d-4839-8a38-5e96a7430546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume fa8bbacc-81c8-4c24-90f4-3ab80eab6669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669', 'volume_size': 1} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:15 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb 1073741824" returned: 0 in 0.501s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:15 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb Nov 02 18:04:15 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (9fa338e4-2ef3-4397-a684-b105ee3fea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c19a88c-42a8-4171-a589-93e3a538d065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c19a88c-42a8-4171-a589-93e3a538d065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676324819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163d503f-8818-4403-bd68-ecb9bbf164a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:15Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6003ecc-7975-48cd-92fa-2784716d8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6003ecc-7975-48cd-92fa-2784716d8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c56c66-722d-4056-9693-440b06ea560a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c56c66-722d-4056-9693-440b06ea560a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163d503f-8818-4403-bd68-ecb9bbf164a1', 'volume_name': 'volume-163d503f-8818-4403-bd68-ecb9bbf164a1', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666f55f9-c1eb-44dc-93d4-d342997b642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (666f55f9-c1eb-44dc-93d4-d342997b642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be34faca-60b7-4120-840c-a8a0983e7bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume 163d503f-8818-4403-bd68-ecb9bbf164a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163d503f-8818-4403-bd68-ecb9bbf164a1', 'volume_size': 1} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:15 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1801795283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8bbacc-81c8-4c24-90f4-3ab80eab6669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:15Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Creating volume fa8bbacc-81c8-4c24-90f4-3ab80eab6669 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:15 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:15 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 1073741824 Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f427af-9614-47ae-ac9f-d963ff6ecc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9aa100-9889-44d8-bf4f-65953d4aa07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb (4e17c015-0dff-4c9e-8142-9a68787a9cdb): created successfully Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9aa100-9889-44d8-bf4f-65953d4aa07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (3d405cf7-69d6-416e-ae0d-a4ae24d9a943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-03bd3bfb-06c1-419c-a818-3abd9effe8b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created volume successfully. Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (678b2685-04f3-4977-a715-b13382b7c566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a86dea-b349-44fb-8ee6-16647ce17b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a86dea-b349-44fb-8ee6-16647ce17b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603974905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70ca0ee-06c5-4c08-9b88-272379f73fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:16Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe8ca99-623c-4804-9420-446692b24602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe8ca99-623c-4804-9420-446692b24602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938e0102-38d6-4c0d-a458-cc013fefdfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938e0102-38d6-4c0d-a458-cc013fefdfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70ca0ee-06c5-4c08-9b88-272379f73fde', 'volume_name': 'volume-a70ca0ee-06c5-4c08-9b88-272379f73fde', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0983c76-f4f7-44ab-8003-b2abe07f8094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0983c76-f4f7-44ab-8003-b2abe07f8094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b39938-0b4e-4c82-a5e7-0d9093fca439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:15 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume a70ca0ee-06c5-4c08-9b88-272379f73fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70ca0ee-06c5-4c08-9b88-272379f73fde', 'volume_size': 1} Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:15 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 1073741824" returned: 0 in 0.495s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:16 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 Nov 02 18:04:16 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (1d23321a-c277-4994-b3a6-26745eff33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c685a6eb-fc85-4b48-aa7d-b5db102492c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c685a6eb-fc85-4b48-aa7d-b5db102492c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1168279835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd21afa-7a43-4cf5-afd8-30986897cc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:16Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f837e258-f10d-4eb9-aa4d-de1756e1454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f837e258-f10d-4eb9-aa4d-de1756e1454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59abe0b3-8113-4384-b779-e47a6e831830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59abe0b3-8113-4384-b779-e47a6e831830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd21afa-7a43-4cf5-afd8-30986897cc5e', 'volume_name': 'volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b65b68-ba78-46a9-b6fb-ab7f4cf1dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4b65b68-ba78-46a9-b6fb-ab7f4cf1dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c078b768-23e4-4e25-a75e-6fc682e9b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume 1cd21afa-7a43-4cf5-afd8-30986897cc5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e', 'volume_size': 1} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:16 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676324819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163d503f-8818-4403-bd68-ecb9bbf164a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:15Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Creating volume 163d503f-8818-4403-bd68-ecb9bbf164a1 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:16 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b7775d4-851d-4839-8a38-5e96a7430546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:16 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 1073741824 Nov 02 18:04:16 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c4ef59-ed2b-4ab3-9f48-8eaa6b275498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:16 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 (fa8bbacc-81c8-4c24-90f4-3ab80eab6669): created successfully Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6c4ef59-ed2b-4ab3-9f48-8eaa6b275498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (5a68679c-1135-4262-8718-9abc13a7db30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2fa87d00-23d9-4a7e-a3ea-6e1ceeb47446 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created volume successfully. Nov 02 18:04:16 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 1073741824" returned: 0 in 0.414s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:16 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 Nov 02 18:04:16 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:17 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-603974905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70ca0ee-06c5-4c08-9b88-272379f73fde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:16Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Creating volume a70ca0ee-06c5-4c08-9b88-272379f73fde {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:17 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be34faca-60b7-4120-840c-a8a0983e7bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163d503f-8818-4403-bd68-ecb9bbf164a1', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4d577d-b9ec-4dbf-a878-6c54301920fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:17 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde 1073741824 Nov 02 18:04:17 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:17 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume volume-163d503f-8818-4403-bd68-ecb9bbf164a1 (163d503f-8818-4403-bd68-ecb9bbf164a1): created successfully Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4d577d-b9ec-4dbf-a878-6c54301920fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (9fa338e4-2ef3-4397-a684-b105ee3fea10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-aae85c1d-3ce4-4af6-b03c-ef0a112fc57e tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created volume successfully. Nov 02 18:04:17 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde 1073741824" returned: 0 in 0.442s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:17 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde Nov 02 18:04:17 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:17 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde" returned: 0 in 0.243s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1168279835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cd21afa-7a43-4cf5-afd8-30986897cc5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345d57ef433d4e72852ef37a2832cfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:16Z,use_quota=True,user_id='9178f6a687254ca4a8381679fdffff60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Creating volume 1cd21afa-7a43-4cf5-afd8-30986897cc5e {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:17 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:17 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e 1073741824 Nov 02 18:04:17 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b39938-0b4e-4c82-a5e7-0d9093fca439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70ca0ee-06c5-4c08-9b88-272379f73fde', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35383282-2ba7-4237-a233-1bd9d5a68f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:17 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume volume-a70ca0ee-06c5-4c08-9b88-272379f73fde (a70ca0ee-06c5-4c08-9b88-272379f73fde): created successfully Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35383282-2ba7-4237-a233-1bd9d5a68f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:17 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (678b2685-04f3-4977-a715-b13382b7c566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1da13490-fd41-4dc7-9a1a-6b2b291f1d12 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created volume successfully. Nov 02 18:04:18 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e 1073741824" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:18 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e Nov 02 18:04:18 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:18 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c078b768-23e4-4e25-a75e-6fc682e9b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70410a2a-f52f-4306-9dee-18c365ae4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Volume volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e (1cd21afa-7a43-4cf5-afd8-30986897cc5e): created successfully Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70410a2a-f52f-4306-9dee-18c365ae4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Flow 'volume_create_manager' (1d23321a-c277-4994-b3a6-26745eff33a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-127dd10a-c9dd-4ae2-9ef7-a7ed69dcdf43 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created volume successfully. Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-1cd21afa-7a43-4cf5-afd8-30986897cc5e-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-1cd21afa-7a43-4cf5-afd8-30986897cc5e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-quobyte-1cd21afa-7a43-4cf5-afd8-30986897cc5e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-1cd21afa-7a43-4cf5-afd8-30986897cc5e" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69fa07d-b47d-4f01-a7e4-ae8c0cb38759]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:19 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e Nov 02 18:04:19 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:19 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e" returned: 0 in 0.352s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:19 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e Nov 02 18:04:19 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:20 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1cd21afa-7a43-4cf5-afd8-30986897cc5e" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-1cd21afa-7a43-4cf5-afd8-30986897cc5e" released by "delete_volume" :: held 0.631s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created reservations ['4afe572d-d9dc-4463-9f0b-f21eca53edcd', '4d6addbd-bf79-481f-8375-303b070394af', '4ca9a38d-94f1-4387-a787-98a9db1abe80', '4c44e80e-c4e9-4cbb-99ea-927fc7bbe3f8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:20 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:20 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:20 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.240s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:20 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Deleted volume successfully. Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-29ef4baf-25df-4330-bde9-4b7bb608cb1c tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-1cd21afa-7a43-4cf5-afd8-30986897cc5e-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-a70ca0ee-06c5-4c08-9b88-272379f73fde-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-a70ca0ee-06c5-4c08-9b88-272379f73fde-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-quobyte-a70ca0ee-06c5-4c08-9b88-272379f73fde" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-a70ca0ee-06c5-4c08-9b88-272379f73fde" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[80871ea2-9c51-4232-b724-e36b6f23b0a0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:20 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde Nov 02 18:04:20 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:21 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde" returned: 0 in 0.347s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:21 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde Nov 02 18:04:21 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:21 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-a70ca0ee-06c5-4c08-9b88-272379f73fde" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-a70ca0ee-06c5-4c08-9b88-272379f73fde" released by "delete_volume" :: held 0.631s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created reservations ['011d0c0e-adc1-4b8e-92f4-2b24ff75bd10', 'b612e412-c662-4392-923e-030ccea512e4', 'bbc7bfd8-701a-49e7-9a1d-21bdcd48c020', '070b0b3c-0578-43cc-b7d0-a6ab7ca84627'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:21 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:21 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:21 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Deleted volume successfully. Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-90da0a19-baef-451c-bcd8-2e6200270a46 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-a70ca0ee-06c5-4c08-9b88-272379f73fde-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-163d503f-8818-4403-bd68-ecb9bbf164a1-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-163d503f-8818-4403-bd68-ecb9bbf164a1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-quobyte-163d503f-8818-4403-bd68-ecb9bbf164a1" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-163d503f-8818-4403-bd68-ecb9bbf164a1" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[32789358-9033-44ab-b58d-1aaf776bd57a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:21 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 Nov 02 18:04:21 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:22 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1" returned: 0 in 0.349s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:22 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1 Nov 02 18:04:22 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:22 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-163d503f-8818-4403-bd68-ecb9bbf164a1" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-163d503f-8818-4403-bd68-ecb9bbf164a1" released by "delete_volume" :: held 0.629s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created reservations ['378719c2-ec52-41a7-80a6-941d6178532c', 'acf0f561-386b-4a4f-a055-540bdca56271', 'abafe224-d5ac-43ce-bfc1-d387716fe523', '47e93e32-3724-4197-9564-5c6516ff9a71'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:22 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:22 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:22 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Deleted volume successfully. Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-e4b7ff11-56c5-4fe5-bdc0-3b65ff61b5b3 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-163d503f-8818-4403-bd68-ecb9bbf164a1-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-fa8bbacc-81c8-4c24-90f4-3ab80eab6669-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-fa8bbacc-81c8-4c24-90f4-3ab80eab6669-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-quobyte-fa8bbacc-81c8-4c24-90f4-3ab80eab6669" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-fa8bbacc-81c8-4c24-90f4-3ab80eab6669" acquired by "delete_volume" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbc0f41-d675-447b-83b1-c6c71ac6dac1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:23 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 Nov 02 18:04:23 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:23 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669" returned: 0 in 0.354s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:23 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669 Nov 02 18:04:23 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:23 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa8bbacc-81c8-4c24-90f4-3ab80eab6669" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-fa8bbacc-81c8-4c24-90f4-3ab80eab6669" released by "delete_volume" :: held 0.636s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created reservations ['bfe7158e-afbb-4f75-9ef5-49104bb47321', '381ef404-a579-4af3-849f-fca2c8764ebc', '0af397ec-d72f-42ce-9156-67574837dacf', '5a44ba4d-f9f4-4912-90e4-cb8c75b7f318'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:23 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:23 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:23 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.240s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Deleted volume successfully. Nov 02 18:04:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-67976b06-0dd0-4e9a-a1de-dcd394eaf31d tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-fa8bbacc-81c8-4c24-90f4-3ab80eab6669-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-4e17c015-0dff-4c9e-8142-9a68787a9cdb-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-4e17c015-0dff-4c9e-8142-9a68787a9cdb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-quobyte-4e17c015-0dff-4c9e-8142-9a68787a9cdb" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-4e17c015-0dff-4c9e-8142-9a68787a9cdb" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbda3b2c-e4b8-43ce-ad9e-219942584b58]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:24 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb Nov 02 18:04:24 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:24 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:24 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb Nov 02 18:04:24 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:24 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-4e17c015-0dff-4c9e-8142-9a68787a9cdb" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-4e17c015-0dff-4c9e-8142-9a68787a9cdb" released by "delete_volume" :: held 0.648s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created reservations ['f8b41045-a70d-48f9-90b3-daab25ecf830', '8093d2ff-a994-4eaf-91f4-0209cb022757', '6d0dbe4e-4b70-47c3-ab67-5c614269b01a', '476917f6-c5cb-478b-9d4d-b0f2984578ac'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:24 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:24 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:25 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.243s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Deleted volume successfully. Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b5dd4564-2917-486d-9742-a97d9ca31933 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-4e17c015-0dff-4c9e-8142-9a68787a9cdb-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-5e34cb77-73a7-476c-8722-a372f4d6b002-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-5e34cb77-73a7-476c-8722-a372f4d6b002-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "cinder-quobyte-5e34cb77-73a7-476c-8722-a372f4d6b002" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-5e34cb77-73a7-476c-8722-a372f4d6b002" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dacc04-cb16-4e07-b1f6-da1df239f1cd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:25 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 Nov 02 18:04:25 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:25 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002" returned: 0 in 0.359s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:25 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002 Nov 02 18:04:25 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:25 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5e34cb77-73a7-476c-8722-a372f4d6b002" returned: 0 in 0.234s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-quobyte-5e34cb77-73a7-476c-8722-a372f4d6b002" released by "delete_volume" :: held 0.635s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:25 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Created reservations ['93aa804c-c889-458d-99b1-dc93aa61444e', '076fe270-19eb-4624-b9ac-2da5d41ca001', '4b6cd845-5054-46c0-b2ca-d409a7ad7479', 'd20409c7-b3d5-458f-b0d5-b4040b40b397'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:26 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:26 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:26 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.243s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Deleted volume successfully. Nov 02 18:04:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-1f44bfe9-2bb8-4ec8-9739-4c9ee53728a7 tempest-CreateVolumesFromSourceVolumeTest-242004316 None] Lock "cinder-5e34cb77-73a7-476c-8722-a372f4d6b002-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Flow 'volume_create_manager' (109f26ad-c70e-48ff-9f49-b7b682c16761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f26be67-aecd-474a-a85b-36ab87b1f349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f26be67-aecd-474a-a85b-36ab87b1f349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116504952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104e2a09-cb40-48ad-9688-fa4f7c423218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80bb0fb5524de38c691a0833628a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:29Z,use_quota=True,user_id='69ec4b9f01b0402b9ce0170c81f80dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9899fa-9e3c-489f-aacc-f3214129fe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f9899fa-9e3c-489f-aacc-f3214129fe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25c56be-7166-4191-98a0-db9609a772be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25c56be-7166-4191-98a0-db9609a772be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '104e2a09-cb40-48ad-9688-fa4f7c423218', 'volume_name': 'volume-104e2a09-cb40-48ad-9688-fa4f7c423218', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca314416-8724-4437-b87f-2aa19310110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca314416-8724-4437-b87f-2aa19310110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0c9bb9-f190-4e64-b51c-c2d47008d6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Volume 104e2a09-cb40-48ad-9688-fa4f7c423218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-104e2a09-cb40-48ad-9688-fa4f7c423218', 'volume_size': 1} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1116504952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104e2a09-cb40-48ad-9688-fa4f7c423218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80bb0fb5524de38c691a0833628a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:29Z,use_quota=True,user_id='69ec4b9f01b0402b9ce0170c81f80dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Creating volume 104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:28 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:29 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 1073741824 Nov 02 18:04:29 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:29 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 1073741824" returned: 0 in 0.403s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:29 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 Nov 02 18:04:29 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:29 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0c9bb9-f190-4e64-b51c-c2d47008d6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104e2a09-cb40-48ad-9688-fa4f7c423218', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7550652-7d70-4c72-91c0-822ce68e30ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Volume volume-104e2a09-cb40-48ad-9688-fa4f7c423218 (104e2a09-cb40-48ad-9688-fa4f7c423218): created successfully Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7550652-7d70-4c72-91c0-822ce68e30ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Flow 'volume_create_manager' (109f26ad-c70e-48ff-9f49-b7b682c16761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b0398b53-c13b-4422-a616-38f2a5c8714a tempest-VolumeDependencyTests-1713116123 None] Created volume successfully. Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Creating offline snapshot cc785ee3-7c5d-4c86-9219-ddd08df8bb44 of volume 104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff564a-3ac1-4567-8c1a-494f07eb7274]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:30 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 Nov 02 18:04:30 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:30 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218" returned: 0 in 0.355s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:30 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 1G Nov 02 18:04:30 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:30 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 1G" returned: 0 in 0.374s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104e2a09-cb40-48ad-9688-fa4f7c423218 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:30 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104e2a09-cb40-48ad-9688-fa4f7c423218 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 Nov 02 18:04:30 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:31 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-104e2a09-cb40-48ad-9688-fa4f7c423218 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44" returned: 0 in 0.292s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:31 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 is being set with open permissions: ugo+rw Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:31 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 Nov 02 18:04:31 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:31 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:31 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info Nov 02 18:04:31 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:31 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info" returned: 0 in 0.245s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:31 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info is being set with open permissions: ugo+rw Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:31 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info Nov 02 18:04:31 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:31 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.info" returned: 0 in 0.231s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-21aea008-d76d-4aab-886a-f65cd44162b6 tempest-VolumeDependencyTests-1713116123 None] Create snapshot completed successfully Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Flow 'volume_create_manager' (0111582a-6147-4727-b8db-6c2dcd33822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2ba17d-1e41-43f5-839f-da2b6e6f99c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2ba17d-1e41-43f5-839f-da2b6e6f99c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-754573236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e16144-a93c-415f-861e-862266130b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f80bb0fb5524de38c691a0833628a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc785ee3-7c5d-4c86-9219-ddd08df8bb44,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:33Z,use_quota=True,user_id='69ec4b9f01b0402b9ce0170c81f80dd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cde30eb-e3d4-4f98-bff1-9e2520927a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cde30eb-e3d4-4f98-bff1-9e2520927a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7871753a-0137-44cd-98f8-bea9f9886dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7871753a-0137-44cd-98f8-bea9f9886dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15e16144-a93c-415f-861e-862266130b6d', 'volume_name': 'volume-15e16144-a93c-415f-861e-862266130b6d', 'volume_size': 1, 'snapshot_id': 'cc785ee3-7c5d-4c86-9219-ddd08df8bb44'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb501d16-e8ba-4375-b4b7-19635e4b2d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb501d16-e8ba-4375-b4b7-19635e4b2d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ccb2ae-59e4-42b0-8796-ee19a71f2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:32 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Volume 15e16144-a93c-415f-861e-862266130b6d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15e16144-a93c-415f-861e-862266130b6d', 'volume_size': 1, 'snapshot_id': 'cc785ee3-7c5d-4c86-9219-ddd08df8bb44'} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-quobyte-cc785ee3-7c5d-4c86-9219-ddd08df8bb44-15e16144-a93c-415f-861e-862266130b6d" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-cc785ee3-7c5d-4c86-9219-ddd08df8bb44-15e16144-a93c-415f-861e-862266130b6d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Creating volume 15e16144-a93c-415f-861e-862266130b6d from snapshot cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-quobyte-15e16144-a93c-415f-861e-862266130b6d" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-15e16144-a93c-415f-861e-862266130b6d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] snapshot: cc785ee3-7c5d-4c86-9219-ddd08df8bb44, volume: 15e16144-a93c-415f-861e-862266130b6d, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ba7aa0-bba5-477f-870e-998e1babd98c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:32 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 Nov 02 18:04:32 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:33 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44" returned: 0 in 0.351s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-104e2a09-cb40-48ad-9688-fa4f7c423218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cd7106-d0e4-4608-b252-7bae85dc1192]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:33 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 Nov 02 18:04:33 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:33 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218" returned: 0 in 0.346s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:04:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:33 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d Nov 02 18:04:33 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:39 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d" returned: 0 in 5.914s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:04:39 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Converted 1024.00 MB image at 173.12 MB/s Nov 02 18:04:39 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d is being set with open permissions: ugo+rw Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:39 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d Nov 02 18:04:39 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:39 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-15e16144-a93c-415f-861e-862266130b6d" released by "_copy_volume_from_snapshot" :: held 6.927s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-cc785ee3-7c5d-4c86-9219-ddd08df8bb44-15e16144-a93c-415f-861e-862266130b6d" released by "_create_volume_from_snapshot" :: held 6.983s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ccb2ae-59e4-42b0-8796-ee19a71f2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e16144-a93c-415f-861e-862266130b6d', 'volume_size': 1, 'snapshot_id': 'cc785ee3-7c5d-4c86-9219-ddd08df8bb44'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3065d28-7fa5-4070-a667-1bbafa5c65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:39 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Volume volume-15e16144-a93c-415f-861e-862266130b6d (15e16144-a93c-415f-861e-862266130b6d): created successfully Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3065d28-7fa5-4070-a667-1bbafa5c65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Flow 'volume_create_manager' (0111582a-6147-4727-b8db-6c2dcd33822d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-17816535-54d7-4324-9394-50b7d49a9ebc tempest-VolumeDependencyTests-1713116123 None] Created volume successfully. Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-cc785ee3-7c5d-4c86-9219-ddd08df8bb44-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-cc785ee3-7c5d-4c86-9219-ddd08df8bb44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-quobyte-104e2a09-cb40-48ad-9688-fa4f7c423218" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-104e2a09-cb40-48ad-9688-fa4f7c423218" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-quobyte-cc785ee3-7c5d-4c86-9219-ddd08df8bb44" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-cc785ee3-7c5d-4c86-9219-ddd08df8bb44" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Deleting offline snapshot cc785ee3-7c5d-4c86-9219-ddd08df8bb44 of volume 104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] snapshot_file for this snap is: volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee36c228-6c38-450b-b338-4f4bcdf7f8a7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:40 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 Nov 02 18:04:40 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:40 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44" returned: 0 in 0.346s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-104e2a09-cb40-48ad-9688-fa4f7c423218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49bfb4e-724b-472b-9a2d-211f769423ef]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:40 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 Nov 02 18:04:40 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:41 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218" returned: 0 in 0.541s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:41 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 Nov 02 18:04:41 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:41 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44" returned: 0 in 0.318s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:41 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44 Nov 02 18:04:41 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:41 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218.cc785ee3-7c5d-4c86-9219-ddd08df8bb44" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-cc785ee3-7c5d-4c86-9219-ddd08df8bb44" released by "_delete_snapshot" :: held 1.540s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-104e2a09-cb40-48ad-9688-fa4f7c423218" released by "delete_snapshot" :: held 1.561s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Created reservations ['9348d392-08ad-4b6a-adce-c66a258a4f3b', '2ec8c807-f97a-4bfd-ad11-f2a59a4c6d33', 'cecc5c46-f64e-4426-8004-12b4fa361d23', '75421ea5-bc47-4a52-80b2-f4cfca6521ef'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Delete snapshot completed successfully. Nov 02 18:04:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b74bc520-3902-4cc8-b93e-36d58835b930 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-cc785ee3-7c5d-4c86-9219-ddd08df8bb44-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-104e2a09-cb40-48ad-9688-fa4f7c423218-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-104e2a09-cb40-48ad-9688-fa4f7c423218-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-quobyte-104e2a09-cb40-48ad-9688-fa4f7c423218" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-104e2a09-cb40-48ad-9688-fa4f7c423218" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b7d5be-d007-4afe-89dd-6de1dda77d5c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:42 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 Nov 02 18:04:42 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:42 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:42 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218 Nov 02 18:04:42 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:43 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-104e2a09-cb40-48ad-9688-fa4f7c423218" returned: 0 in 0.237s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-104e2a09-cb40-48ad-9688-fa4f7c423218" released by "delete_volume" :: held 0.647s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Created reservations ['66c7ca8f-08f1-40aa-b281-4f1988463ba1', 'bb2074bc-9d3e-4aae-8a74-d2929354278a', '639677fc-5ed3-4743-a66c-cb12930faa40', '6c87b3bc-2ed0-48c1-87e9-042b44f0f377'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:43 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:43 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:43 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.237s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Deleted volume successfully. Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6927d4a2-b184-45df-999d-644ccf04fd36 tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-104e2a09-cb40-48ad-9688-fa4f7c423218-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-15e16144-a93c-415f-861e-862266130b6d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-15e16144-a93c-415f-861e-862266130b6d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "cinder-quobyte-15e16144-a93c-415f-861e-862266130b6d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-15e16144-a93c-415f-861e-862266130b6d" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48af2e6-1364-4c5f-ac17-ec18caea7483]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:43 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d Nov 02 18:04:43 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:43 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d" returned: 0 in 0.355s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:44 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d Nov 02 18:04:44 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:44 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15e16144-a93c-415f-861e-862266130b6d" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-quobyte-15e16144-a93c-415f-861e-862266130b6d" released by "delete_volume" :: held 0.649s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Created reservations ['4fc357c6-b459-438a-8a8a-4cad4b484ea6', '9ee65dde-614a-42a6-aa4a-362ec71d9e36', 'fb6652c1-e9d2-4abb-aeeb-8f9ede238c1a', 'f76dc634-feab-4f75-b9b7-7d30f837ab76'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:44 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:44 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:44 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.241s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Deleted volume successfully. Nov 02 18:04:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d62aa141-149c-4e2d-8bdf-0b5cf57f43cc tempest-VolumeDependencyTests-1713116123 None] Lock "cinder-15e16144-a93c-415f-861e-862266130b6d-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:46 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:46 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:46 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.240s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:04:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:04:54 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=103,cinder:UPDATE=145,cinder:INSERT=33,cinder:DELETE=17 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:04:54 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=156,cinder:SELECT=101,cinder:INSERT=37,cinder:DELETE=10 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (24ccb39c-3638-4303-bdb1-4f72cedfc9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddc79ef-81d4-4026-be3f-8782d2b31ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddc79ef-81d4-4026-be3f-8782d2b31ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243057271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa4b454-ac64-404c-8ed0-2eb3569a1195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:56Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e436305-bb88-423c-9241-926bcba4d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e436305-bb88-423c-9241-926bcba4d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff9276d-37a1-4770-8f87-5bb42cab11b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff9276d-37a1-4770-8f87-5bb42cab11b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa4b454-ac64-404c-8ed0-2eb3569a1195', 'volume_name': 'volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1661712d-4dd4-41c0-8817-eb1bd54cd694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1661712d-4dd4-41c0-8817-eb1bd54cd694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a81fc31-3352-419f-822e-5ca2f24bd8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:56 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Volume ffa4b454-ac64-404c-8ed0-2eb3569a1195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195', 'volume_size': 1} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-243057271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa4b454-ac64-404c-8ed0-2eb3569a1195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:56Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Creating volume ffa4b454-ac64-404c-8ed0-2eb3569a1195 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:56 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:56 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 1073741824 Nov 02 18:04:56 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:56 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 1073741824" returned: 0 in 0.403s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:57 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 Nov 02 18:04:57 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:57 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a81fc31-3352-419f-822e-5ca2f24bd8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2cd65a-4bd8-403c-9cc8-0c87db374abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:57 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Volume volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 (ffa4b454-ac64-404c-8ed0-2eb3569a1195): created successfully Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b2cd65a-4bd8-403c-9cc8-0c87db374abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (24ccb39c-3638-4303-bdb1-4f72cedfc9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c6caca8e-cb9d-4137-80fe-cf1db3b04367 tempest-ProjectReaderTests-1753606014 None] Created volume successfully. Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-ffa4b454-ac64-404c-8ed0-2eb3569a1195-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-ffa4b454-ac64-404c-8ed0-2eb3569a1195-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-quobyte-ffa4b454-ac64-404c-8ed0-2eb3569a1195" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-ffa4b454-ac64-404c-8ed0-2eb3569a1195" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8142737-fdde-409f-b9a0-663de54e4a4e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:04:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:57 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 Nov 02 18:04:57 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:58 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:58 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195 Nov 02 18:04:58 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:58 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ffa4b454-ac64-404c-8ed0-2eb3569a1195" returned: 0 in 0.251s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-ffa4b454-ac64-404c-8ed0-2eb3569a1195" released by "delete_volume" :: held 0.641s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Created reservations ['8431b8b3-0d77-4c89-86ee-55ffcab86cdd', '3ffaba60-313d-44ec-97e5-e73992604326', '606f9dae-cf78-4971-8075-9a2f9f9a2bd8', 'b8262beb-0bb2-471d-bf84-4dc8012ca624'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:58 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:04:58 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:58 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:04:58 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Deleted volume successfully. Nov 02 18:04:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-733b4ea7-0d11-4433-9905-127f92fba8b7 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-ffa4b454-ac64-404c-8ed0-2eb3569a1195-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (a5b895e7-a22c-41a2-9d90-305040ee4915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538954b0-8398-45e7-906e-91909b43e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538954b0-8398-45e7-906e-91909b43e226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919398237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15456ade-700d-4bbe-8585-491f7b929287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:59Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faff3a5-8fe0-4d3e-a1ca-0cadbe464824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9faff3a5-8fe0-4d3e-a1ca-0cadbe464824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a0c37-2ef8-455a-895b-29583fdaf803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e2a0c37-2ef8-455a-895b-29583fdaf803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15456ade-700d-4bbe-8585-491f7b929287', 'volume_name': 'volume-15456ade-700d-4bbe-8585-491f7b929287', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff50aee4-b07c-40da-93b7-d359b70d1540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff50aee4-b07c-40da-93b7-d359b70d1540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d4186-185e-4145-9f5f-84dc725376d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:04:59 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Volume 15456ade-700d-4bbe-8585-491f7b929287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15456ade-700d-4bbe-8585-491f7b929287', 'volume_size': 1} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919398237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15456ade-700d-4bbe-8585-491f7b929287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:04:59Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Creating volume 15456ade-700d-4bbe-8585-491f7b929287 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:04:59 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:59 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 1073741824 Nov 02 18:04:59 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:04:59 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 1073741824" returned: 0 in 0.404s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:04:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:04:59 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 Nov 02 18:04:59 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:00 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960d4186-185e-4145-9f5f-84dc725376d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15456ade-700d-4bbe-8585-491f7b929287', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143f0e5f-9b56-413e-9b58-61437dd7f9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Volume volume-15456ade-700d-4bbe-8585-491f7b929287 (15456ade-700d-4bbe-8585-491f7b929287): created successfully Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143f0e5f-9b56-413e-9b58-61437dd7f9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (a5b895e7-a22c-41a2-9d90-305040ee4915) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d0182f48-27c3-46f4-9b7d-dda33afb6b29 tempest-ProjectReaderTests-1753606014 None] Created volume successfully. Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-15456ade-700d-4bbe-8585-491f7b929287-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Lock "cinder-15456ade-700d-4bbe-8585-491f7b929287-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-quobyte-15456ade-700d-4bbe-8585-491f7b929287" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-15456ade-700d-4bbe-8585-491f7b929287" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af1773b-bf66-464f-9b18-27ca3a079ad8]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:00 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 Nov 02 18:05:00 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:00 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287" returned: 0 in 0.349s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:00 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287 Nov 02 18:05:00 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:00 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-15456ade-700d-4bbe-8585-491f7b929287" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-15456ade-700d-4bbe-8585-491f7b929287" released by "delete_volume" :: held 0.625s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Created reservations ['7a6f5f4f-30e6-47da-a3c5-005f20c42b33', '0f2f4c66-877d-47a3-a31b-4a3d693fc298', '7db5afcc-645e-4bb9-a2bf-d6b988342475', '933c348a-1a62-4bc9-a2ae-995dea7571f5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:01 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:05:01 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:01 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:05:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Deleted volume successfully. Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c8f71848-684b-4718-b754-a07a663a7b8b tempest-ProjectReaderTests-1753606014 None] Lock "cinder-15456ade-700d-4bbe-8585-491f7b929287-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (6019ea51-94ea-4a30-a17a-7dc566f37655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6f0baf-e37b-4960-9dfb-8091c7f70529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f6f0baf-e37b-4960-9dfb-8091c7f70529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649443180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b2565e-fe57-4fc9-a8f7-b94bddd79841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:02Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9425f98f-fc28-460f-a57b-4b441b5337c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9425f98f-fc28-460f-a57b-4b441b5337c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89580413-32af-47ab-b404-bbbc30f6b2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89580413-32af-47ab-b404-bbbc30f6b2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b2565e-fe57-4fc9-a8f7-b94bddd79841', 'volume_name': 'volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3487b043-3eee-448e-85c8-aa3fb91a6502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3487b043-3eee-448e-85c8-aa3fb91a6502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352d63bd-590a-4151-a32f-cdecfb5c1987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Volume 12b2565e-fe57-4fc9-a8f7-b94bddd79841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841', 'volume_size': 1} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649443180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b2565e-fe57-4fc9-a8f7-b94bddd79841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:02Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Creating volume 12b2565e-fe57-4fc9-a8f7-b94bddd79841 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:05:01 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:05:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:01 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 1073741824 Nov 02 18:05:01 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:02 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 1073741824" returned: 0 in 0.402s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:02 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 Nov 02 18:05:02 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:02 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352d63bd-590a-4151-a32f-cdecfb5c1987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d799f91-272b-4a23-8fe7-0e975614cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:02 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Volume volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 (12b2565e-fe57-4fc9-a8f7-b94bddd79841): created successfully Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d799f91-272b-4a23-8fe7-0e975614cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (6019ea51-94ea-4a30-a17a-7dc566f37655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-05d58228-5635-4543-888d-5f6eb49ed848 tempest-ProjectReaderTests-1753606014 None] Created volume successfully. Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-12b2565e-fe57-4fc9-a8f7-b94bddd79841-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Lock "cinder-12b2565e-fe57-4fc9-a8f7-b94bddd79841-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-quobyte-12b2565e-fe57-4fc9-a8f7-b94bddd79841" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-12b2565e-fe57-4fc9-a8f7-b94bddd79841" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c8eeb3-2a71-4eb3-8a3f-c8b1a0431eca]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:03 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 Nov 02 18:05:03 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:03 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841" returned: 0 in 0.351s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:03 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841 Nov 02 18:05:03 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:03 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-12b2565e-fe57-4fc9-a8f7-b94bddd79841" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-12b2565e-fe57-4fc9-a8f7-b94bddd79841" released by "delete_volume" :: held 0.634s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Created reservations ['09b694f0-8c3c-4120-bf17-9ca78ad9bdcb', 'b59c8c7e-6be6-4199-aae5-b642d13a5a3d', 'a6955831-0fac-4344-924e-13ad10bb615b', 'd7ad08c2-d354-4b66-a2ff-ee9477782349'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:03 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:05:03 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:03 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.234s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:05:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Deleted volume successfully. Nov 02 18:05:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-91d17bdf-743d-467e-bbfd-f44ea3083b3a tempest-ProjectReaderTests-1753606014 None] Lock "cinder-12b2565e-fe57-4fc9-a8f7-b94bddd79841-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (70dfe926-9bf1-4ea8-a1f3-a1876bd3be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee435751-4089-4368-b3ba-20f08950ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee435751-4089-4368-b3ba-20f08950ebae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830400271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc93f700-1bd8-452f-924d-e946651bfb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:04Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc1af68-c96a-4161-9259-3dc867013312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fc1af68-c96a-4161-9259-3dc867013312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c766b8c-b67d-4a2d-8181-8b2e0c683250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c766b8c-b67d-4a2d-8181-8b2e0c683250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc93f700-1bd8-452f-924d-e946651bfb04', 'volume_name': 'volume-cc93f700-1bd8-452f-924d-e946651bfb04', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27439c90-8c5a-486b-9f18-19169faf94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27439c90-8c5a-486b-9f18-19169faf94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d89aa4-ba1f-4c1a-90f9-c5dbb0f6e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Volume cc93f700-1bd8-452f-924d-e946651bfb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc93f700-1bd8-452f-924d-e946651bfb04', 'volume_size': 1} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-830400271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc93f700-1bd8-452f-924d-e946651bfb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2abad05c795436da163e0c58168dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:04Z,use_quota=True,user_id='7737a799622b497e8be9d3abb8006e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Creating volume cc93f700-1bd8-452f-924d-e946651bfb04 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:05:04 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:04 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 1073741824 Nov 02 18:05:04 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:04 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 1073741824" returned: 0 in 0.389s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:05 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 Nov 02 18:05:05 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:05 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d89aa4-ba1f-4c1a-90f9-c5dbb0f6e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc93f700-1bd8-452f-924d-e946651bfb04', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae774858-a2dd-44f4-a632-d302f58dfcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Volume volume-cc93f700-1bd8-452f-924d-e946651bfb04 (cc93f700-1bd8-452f-924d-e946651bfb04): created successfully Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae774858-a2dd-44f4-a632-d302f58dfcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Flow 'volume_create_manager' (70dfe926-9bf1-4ea8-a1f3-a1876bd3be60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-1bf0fd49-b92d-41e2-b4c3-488596a34117 tempest-ProjectReaderTests-1753606014 None] Created volume successfully. Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-cc93f700-1bd8-452f-924d-e946651bfb04-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-cc93f700-1bd8-452f-924d-e946651bfb04-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "cinder-quobyte-cc93f700-1bd8-452f-924d-e946651bfb04" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-cc93f700-1bd8-452f-924d-e946651bfb04" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c051e1-77c8-4eaa-8b85-dc23c9df4cc1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:05 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 Nov 02 18:05:05 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:05 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04" returned: 0 in 0.341s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:05 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04 Nov 02 18:05:05 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:06 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cc93f700-1bd8-452f-924d-e946651bfb04" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-quobyte-cc93f700-1bd8-452f-924d-e946651bfb04" released by "delete_volume" :: held 0.636s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Created reservations ['514746e0-e677-484a-b7af-6172b0da1d90', '6cdbdca0-12d8-4f27-b0b3-32b75c850781', '54cb4916-5aa7-4bbd-9b8b-c71771ca6ebd', '99a88ed8-3a95-4fb9-be6d-7d2313644a55'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:06 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:05:06 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:06 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:05:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Deleted volume successfully. Nov 02 18:05:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0de7e273-5533-4210-b9c6-a5ef0d152506 tempest-ProjectReaderTests-1753606014 None] Lock "cinder-cc93f700-1bd8-452f-924d-e946651bfb04-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:16 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=27,cinder:UPDATE=43,cinder:DELETE=6,cinder:INSERT=12 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:05:16 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=45,cinder:SELECT=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Flow 'volume_create_manager' (5e603a33-7a6f-4c54-a14b-4b7fead14c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51041122-fd2d-43ad-97cb-aa7cd00276f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51041122-fd2d-43ad-97cb-aa7cd00276f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1797574879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f70078c-06b3-4c58-8c57-1e498ad6c316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a26d217f84ec1b310dcfb386107b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:27Z,use_quota=True,user_id='b8c7fc9a4ab44593b9a46f570a98a1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e7bf25-598b-4a83-83de-906ba7c68157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e7bf25-598b-4a83-83de-906ba7c68157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12472b7-de29-46ea-8bb9-261eb8905844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12472b7-de29-46ea-8bb9-261eb8905844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f70078c-06b3-4c58-8c57-1e498ad6c316', 'volume_name': 'volume-7f70078c-06b3-4c58-8c57-1e498ad6c316', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931d2757-b749-48b5-a075-f1a4b74d69d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931d2757-b749-48b5-a075-f1a4b74d69d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80fa7f-e3c0-4009-867c-6a2df3769726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Volume 7f70078c-06b3-4c58-8c57-1e498ad6c316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f70078c-06b3-4c58-8c57-1e498ad6c316', 'volume_size': 1} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1797574879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f70078c-06b3-4c58-8c57-1e498ad6c316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a26d217f84ec1b310dcfb386107b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:27Z,use_quota=True,user_id='b8c7fc9a4ab44593b9a46f570a98a1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Creating volume 7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:05:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:27 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 1073741824 Nov 02 18:05:27 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:27 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 1073741824" returned: 0 in 0.475s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:27 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 Nov 02 18:05:27 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:28 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316" returned: 0 in 0.243s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a80fa7f-e3c0-4009-867c-6a2df3769726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f70078c-06b3-4c58-8c57-1e498ad6c316', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81d605f-2d35-496b-9417-3afdae870166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Volume volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 (7f70078c-06b3-4c58-8c57-1e498ad6c316): created successfully Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e81d605f-2d35-496b-9417-3afdae870166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Flow 'volume_create_manager' (5e603a33-7a6f-4c54-a14b-4b7fead14c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dda9d2f6-aa63-4f2a-8a4e-b8a05c938447 tempest-SnapshotDependencyTests-1166603937 None] Created volume successfully. Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Creating offline snapshot 240d8c80-139c-44ca-ad61-0fafe581999c of volume 7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c95a810-1193-4d33-837b-23e224b9b6b7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:28 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 Nov 02 18:05:28 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:28 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316" returned: 0 in 0.355s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:28 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c 1G Nov 02 18:05:28 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:29 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c 1G" returned: 0 in 0.405s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:29 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c Nov 02 18:05:29 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:29 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:29 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c is being set with open permissions: ugo+rw Nov 02 18:05:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:29 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c Nov 02 18:05:29 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:29 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:29 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info Nov 02 18:05:29 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:30 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info" returned: 0 in 0.257s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:30 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info is being set with open permissions: ugo+rw Nov 02 18:05:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:30 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info Nov 02 18:05:30 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:30 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.info" returned: 0 in 0.241s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-327bd198-f472-484a-a628-0ec2e7902fc7 tempest-SnapshotDependencyTests-1166603937 None] Create snapshot completed successfully Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Flow 'volume_create_manager' (9e42aedf-5c68-4f1a-aa2c-59369c5f7978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fa9cae-84ed-46d8-bea8-aa4c3fbc5135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01fa9cae-84ed-46d8-bea8-aa4c3fbc5135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e0cee7-35b7-4252-b027-7ab890a61ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f1a26d217f84ec1b310dcfb386107b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=240d8c80-139c-44ca-ad61-0fafe581999c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:05:31Z,use_quota=True,user_id='b8c7fc9a4ab44593b9a46f570a98a1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec229db8-29fc-45a5-9622-fa992e05f720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec229db8-29fc-45a5-9622-fa992e05f720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e80845-0a9d-4d2c-a80a-7b59c5b74f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e80845-0a9d-4d2c-a80a-7b59c5b74f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44e0cee7-35b7-4252-b027-7ab890a61ab0', 'volume_name': 'volume-44e0cee7-35b7-4252-b027-7ab890a61ab0', 'volume_size': 1, 'snapshot_id': '240d8c80-139c-44ca-ad61-0fafe581999c'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882eee4b-d789-434f-8f5d-6be836a089fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882eee4b-d789-434f-8f5d-6be836a089fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77930fc4-6296-4413-90f0-884b424e9c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:31 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Volume 44e0cee7-35b7-4252-b027-7ab890a61ab0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44e0cee7-35b7-4252-b027-7ab890a61ab0', 'volume_size': 1, 'snapshot_id': '240d8c80-139c-44ca-ad61-0fafe581999c'} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-quobyte-240d8c80-139c-44ca-ad61-0fafe581999c-44e0cee7-35b7-4252-b027-7ab890a61ab0" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-240d8c80-139c-44ca-ad61-0fafe581999c-44e0cee7-35b7-4252-b027-7ab890a61ab0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Creating volume 44e0cee7-35b7-4252-b027-7ab890a61ab0 from snapshot 240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-quobyte-44e0cee7-35b7-4252-b027-7ab890a61ab0" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-44e0cee7-35b7-4252-b027-7ab890a61ab0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] snapshot: 240d8c80-139c-44ca-ad61-0fafe581999c, volume: 44e0cee7-35b7-4252-b027-7ab890a61ab0, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60bc881-07aa-4e4e-9ae0-2263bf807dee]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:31 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c Nov 02 18:05:31 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:31 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f70078c-06b3-4c58-8c57-1e498ad6c316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115c06c-7736-4026-bb12-1321bffddf3a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:31 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 Nov 02 18:05:31 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:31 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316" returned: 0 in 0.349s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:05:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:32 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 Nov 02 18:05:32 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:37 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0" returned: 0 in 5.843s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:37 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:05:37 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Converted 1024.00 MB image at 175.22 MB/s Nov 02 18:05:37 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 is being set with open permissions: ugo+rw Nov 02 18:05:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:37 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 Nov 02 18:05:37 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:38 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0" returned: 0 in 0.234s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-44e0cee7-35b7-4252-b027-7ab890a61ab0" released by "_copy_volume_from_snapshot" :: held 6.859s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-240d8c80-139c-44ca-ad61-0fafe581999c-44e0cee7-35b7-4252-b027-7ab890a61ab0" released by "_create_volume_from_snapshot" :: held 6.914s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.928s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77930fc4-6296-4413-90f0-884b424e9c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e0cee7-35b7-4252-b027-7ab890a61ab0', 'volume_size': 1, 'snapshot_id': '240d8c80-139c-44ca-ad61-0fafe581999c'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d000cc21-46ba-4d86-b30e-9c598ff62c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:05:38 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Volume volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 (44e0cee7-35b7-4252-b027-7ab890a61ab0): created successfully Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d000cc21-46ba-4d86-b30e-9c598ff62c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Flow 'volume_create_manager' (9e42aedf-5c68-4f1a-aa2c-59369c5f7978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:05:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-fd12e79d-fb6d-46e3-8a4d-c40470f11354 tempest-SnapshotDependencyTests-1166603937 None] Created volume successfully. Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-240d8c80-139c-44ca-ad61-0fafe581999c-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-240d8c80-139c-44ca-ad61-0fafe581999c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-quobyte-7f70078c-06b3-4c58-8c57-1e498ad6c316" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-7f70078c-06b3-4c58-8c57-1e498ad6c316" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-quobyte-240d8c80-139c-44ca-ad61-0fafe581999c" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-240d8c80-139c-44ca-ad61-0fafe581999c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Deleting offline snapshot 240d8c80-139c-44ca-ad61-0fafe581999c of volume 7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] snapshot_file for this snap is: volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2975b1d-810a-4518-8f31-edc50356f618]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:38 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c Nov 02 18:05:38 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:39 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c" returned: 0 in 0.354s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f70078c-06b3-4c58-8c57-1e498ad6c316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:05:39 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f033ca91-3335-4f96-812d-c9a7af2ba50b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:39 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 Nov 02 18:05:39 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:39 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316" returned: 0 in 0.552s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:39 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c Nov 02 18:05:39 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:40 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c" returned: 0 in 0.335s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:40 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c Nov 02 18:05:40 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:40 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316.240d8c80-139c-44ca-ad61-0fafe581999c" returned: 0 in 0.241s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-240d8c80-139c-44ca-ad61-0fafe581999c" released by "_delete_snapshot" :: held 1.580s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-7f70078c-06b3-4c58-8c57-1e498ad6c316" released by "delete_snapshot" :: held 1.600s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Created reservations ['a1051ffc-0188-4f48-aecb-a1b456fda71c', '2f9419d0-2dfe-439a-958c-dfffd34a4932', '24df766b-6f49-4baa-9805-40644d7f7747', '6e75e942-e8e5-436b-9166-73d42c0e3b7e'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:05:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Delete snapshot completed successfully. Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ddd5cbf-0982-410f-a910-9cda2d7f5a73 tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-240d8c80-139c-44ca-ad61-0fafe581999c-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-7f70078c-06b3-4c58-8c57-1e498ad6c316-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-7f70078c-06b3-4c58-8c57-1e498ad6c316-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-quobyte-7f70078c-06b3-4c58-8c57-1e498ad6c316" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-7f70078c-06b3-4c58-8c57-1e498ad6c316" acquired by "delete_volume" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2909252b-0d62-44ac-af02-bd94b00b3526]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:41 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 Nov 02 18:05:41 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:41 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316" returned: 0 in 0.364s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:41 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316 Nov 02 18:05:41 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:41 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7f70078c-06b3-4c58-8c57-1e498ad6c316" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-7f70078c-06b3-4c58-8c57-1e498ad6c316" released by "delete_volume" :: held 0.658s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Created reservations ['b51ee6d2-bfce-49f3-955e-cd819c30558f', '13e5f98d-8b9e-4ed8-b4d7-d2a9a59ba64f', '2465d49e-0a7e-49a2-825a-d246e492b4d5', 'f06c04c3-bba9-476b-9b31-3cda163dce9b'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:41 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:05:41 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:41 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.247s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:05:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Deleted volume successfully. Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-538d37c9-8985-48e8-a9a3-8d46a54f06fd tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-7f70078c-06b3-4c58-8c57-1e498ad6c316-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-44e0cee7-35b7-4252-b027-7ab890a61ab0-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-44e0cee7-35b7-4252-b027-7ab890a61ab0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "cinder-quobyte-44e0cee7-35b7-4252-b027-7ab890a61ab0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-44e0cee7-35b7-4252-b027-7ab890a61ab0" acquired by "delete_volume" :: waited 0.013s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d11286-3486-4d29-94e1-4f691db20590]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:42 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 Nov 02 18:05:42 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:42 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0" returned: 0 in 0.343s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:42 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0 Nov 02 18:05:42 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:42 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-44e0cee7-35b7-4252-b027-7ab890a61ab0" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-quobyte-44e0cee7-35b7-4252-b027-7ab890a61ab0" released by "delete_volume" :: held 0.627s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Created reservations ['91f48b5a-fe63-429a-b4c4-8ea73d5c2539', '5494ce25-abf5-4b71-8d61-9153c60b71df', '0c97fa8d-628f-4bc5-8205-8ee966ed7f61', '2bdec4fe-b089-4f04-864b-4240b5da92f2'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:42 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:05:42 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:43 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.239s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:43 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:05:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Deleted volume successfully. Nov 02 18:05:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2f226504-5d07-4b33-8a70-2b972c49b5aa tempest-SnapshotDependencyTests-1166603937 None] Lock "cinder-44e0cee7-35b7-4252-b027-7ab890a61ab0-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:05:46 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:05:46 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:05:46 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:05:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:05:52 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=27,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:05:53 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=35,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (14aa3b88-f68e-44c8-9d70-a1452e3463a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a39eb8b-5dc2-4c97-ba93-46a2efd5300a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a39eb8b-5dc2-4c97-ba93-46a2efd5300a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990743556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd63443-fcf3-453d-b2c2-b2bc5356bd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:04Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0042515c-aa55-49b0-a086-bbc5ea673ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0042515c-aa55-49b0-a086-bbc5ea673ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302e30f5-f7b9-42d2-a0fb-293a95ef9046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (302e30f5-f7b9-42d2-a0fb-293a95ef9046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd63443-fcf3-453d-b2c2-b2bc5356bd4a', 'volume_name': 'volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72034fe7-9df4-4a15-82c1-b0aef21eb11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72034fe7-9df4-4a15-82c1-b0aef21eb11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bbc326-3758-4624-9dbc-ecb483f59525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:03 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Volume 7cd63443-fcf3-453d-b2c2-b2bc5356bd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a', 'volume_size': 1} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-990743556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd63443-fcf3-453d-b2c2-b2bc5356bd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:04Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Creating volume 7cd63443-fcf3-453d-b2c2-b2bc5356bd4a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:03 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:04 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a 1073741824 Nov 02 18:06:04 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (936959dc-3d91-40f4-8144-aabab336b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:04 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b774e1-eca4-4c1b-9371-252c181c58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a 1073741824" returned: 0 in 0.635s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b774e1-eca4-4c1b-9371-252c181c58a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117665890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1ea678-5407-44db-8305-5978760f8b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:04Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea7ce5-3a56-49cf-95ef-70d028312059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea7ce5-3a56-49cf-95ef-70d028312059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f80a387-7ed4-42c6-9787-95ad201007cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f80a387-7ed4-42c6-9787-95ad201007cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1ea678-5407-44db-8305-5978760f8b41', 'volume_name': 'volume-2f1ea678-5407-44db-8305-5978760f8b41', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cc0cd7-c484-4084-9694-5079b642959d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cc0cd7-c484-4084-9694-5079b642959d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129339c8-b638-4716-a7c5-53aede1883e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Volume 2f1ea678-5407-44db-8305-5978760f8b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1ea678-5407-44db-8305-5978760f8b41', 'volume_size': 1} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:04 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a Nov 02 18:06:04 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (aa6108c5-7c89-4ee0-988e-7ce8434666f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2792bf-ee7f-4328-8d8f-aad07d52858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2792bf-ee7f-4328-8d8f-aad07d52858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773995055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717a5b97-37f6-4c8c-a58a-9a0bd834a306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:05Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa94507b-0a60-44bb-a2a5-1b9e44dfef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa94507b-0a60-44bb-a2a5-1b9e44dfef98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500f5717-9885-45b4-9c5c-ac821433c033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500f5717-9885-45b4-9c5c-ac821433c033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717a5b97-37f6-4c8c-a58a-9a0bd834a306', 'volume_name': 'volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f826bf91-05a8-4a3d-ae28-bfc410257283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f826bf91-05a8-4a3d-ae28-bfc410257283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddadd84-4ca5-4543-8473-c99572c732f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume 717a5b97-37f6-4c8c-a58a-9a0bd834a306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306', 'volume_size': 1} Nov 02 18:06:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:05 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a" returned: 0 in 0.364s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117665890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1ea678-5407-44db-8305-5978760f8b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:04Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Creating volume 2f1ea678-5407-44db-8305-5978760f8b41 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:05 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bbc326-3758-4624-9dbc-ecb483f59525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a946fb5a-2875-43f4-addb-0bb49b4fde98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 1073741824 Nov 02 18:06:05 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (59e70202-fce4-436e-9554-d9f3bc46247e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42794de-334c-4b58-9fe1-5efc7ecaf0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Volume volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a (7cd63443-fcf3-453d-b2c2-b2bc5356bd4a): created successfully Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a946fb5a-2875-43f4-addb-0bb49b4fde98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (14aa3b88-f68e-44c8-9d70-a1452e3463a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42794de-334c-4b58-9fe1-5efc7ecaf0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306017622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24092726-9a4c-49e9-8932-be4d18679c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:05Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82bdda1-e83f-430c-bbff-ff26d0f048e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82bdda1-e83f-430c-bbff-ff26d0f048e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18618ea-4753-4af6-a445-a4ec8ee9ac29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18618ea-4753-4af6-a445-a4ec8ee9ac29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24092726-9a4c-49e9-8932-be4d18679c77', 'volume_name': 'volume-24092726-9a4c-49e9-8932-be4d18679c77', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb06083-356c-47db-9cd8-7b94d38090bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb06083-356c-47db-9cd8-7b94d38090bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de633f8d-37ae-471c-b8d1-7d488782642d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Volume 24092726-9a4c-49e9-8932-be4d18679c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24092726-9a4c-49e9-8932-be4d18679c77', 'volume_size': 1} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-aba5d886-e68e-408a-b981-b0e3ec973f70 tempest-CreateVolumesFromImageTest-236403904 None] Created volume successfully. Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (17e6e83a-e531-4648-9e71-a3bc37277440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725cad08-68d3-4856-a055-716119d60c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725cad08-68d3-4856-a055-716119d60c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927816390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c03791-5f66-419b-ba4f-6cb5a8d45148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:05Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b496b1-1b4e-4cb4-a06b-3c851b09b4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b496b1-1b4e-4cb4-a06b-3c851b09b4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b302ee-d869-478e-b366-2b74a6b17cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b302ee-d869-478e-b366-2b74a6b17cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c03791-5f66-419b-ba4f-6cb5a8d45148', 'volume_name': 'volume-72c03791-5f66-419b-ba4f-6cb5a8d45148', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82517fff-c6bb-4ffe-804f-3a1a9fce567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82517fff-c6bb-4ffe-804f-3a1a9fce567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14483896-a2da-4969-96cf-c52ca6b4fc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:05 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Volume 72c03791-5f66-419b-ba4f-6cb5a8d45148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c03791-5f66-419b-ba4f-6cb5a8d45148', 'volume_size': 1} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:05 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 1073741824" returned: 0 in 0.659s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:05 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 Nov 02 18:06:05 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (0ac0337e-144b-4aa9-bf8c-fde30a6d7690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720562ea-11e6-4b7c-8252-150c8c9cbe03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41" returned: 0 in 0.280s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773995055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717a5b97-37f6-4c8c-a58a-9a0bd834a306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:05Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Creating volume 717a5b97-37f6-4c8c-a58a-9a0bd834a306 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720562ea-11e6-4b7c-8252-150c8c9cbe03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657061465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f89acd9-6e88-4a68-91d1-d797d3865f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:06Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 1073741824 Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d64c4-dc51-4ee5-9a65-c4d84df6e554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d64c4-dc51-4ee5-9a65-c4d84df6e554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f2dd6e-43a9-4c3b-8a56-ef1e4faad102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f2dd6e-43a9-4c3b-8a56-ef1e4faad102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f89acd9-6e88-4a68-91d1-d797d3865f86', 'volume_name': 'volume-1f89acd9-6e88-4a68-91d1-d797d3865f86', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fdc979-8b90-49c7-8036-619a9e6c34f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fdc979-8b90-49c7-8036-619a9e6c34f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142922e0-8d0a-436f-949c-6f88876b206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Volume 1f89acd9-6e88-4a68-91d1-d797d3865f86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f89acd9-6e88-4a68-91d1-d797d3865f86', 'volume_size': 1} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (c15b83a2-5ff4-439e-bdd7-92ba301ea000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777863f0-34a9-4120-8c88-23c3f568a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129339c8-b638-4716-a7c5-53aede1883e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1ea678-5407-44db-8305-5978760f8b41', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf94bac-da42-45f9-b6d2-22b8d1639cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777863f0-34a9-4120-8c88-23c3f568a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932820121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cce7630-7364-4ad9-bf41-05cd494ba3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:06Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c9d666-782f-447f-8496-935f76290781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c9d666-782f-447f-8496-935f76290781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da233eba-2bf0-4c28-a4f9-46d7d48a24c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da233eba-2bf0-4c28-a4f9-46d7d48a24c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cce7630-7364-4ad9-bf41-05cd494ba3cc', 'volume_name': 'volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5734b714-ed38-4753-8d0c-6ebe888a4b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5734b714-ed38-4753-8d0c-6ebe888a4b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0cfef5-34b3-4897-a3d0-2df58be6f9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Volume 5cce7630-7364-4ad9-bf41-05cd494ba3cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc', 'volume_size': 1} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Volume volume-2f1ea678-5407-44db-8305-5978760f8b41 (2f1ea678-5407-44db-8305-5978760f8b41): created successfully Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bf94bac-da42-45f9-b6d2-22b8d1639cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (936959dc-3d91-40f4-8144-aabab336b18a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a96c0d91-cc15-4594-a49c-e8c7349ed01c tempest-CreateVolumesFromImageTest-236403904 None] Created volume successfully. Nov 02 18:06:06 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 1073741824" returned: 0 in 0.449s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:06 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 Nov 02 18:06:06 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:06 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306017622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24092726-9a4c-49e9-8932-be4d18679c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:05Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Creating volume 24092726-9a4c-49e9-8932-be4d18679c77 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddadd84-4ca5-4543-8473-c99572c732f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 1073741824 Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e261e2-0eea-4831-b24d-26aa51d77700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:06 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 (717a5b97-37f6-4c8c-a58a-9a0bd834a306): created successfully Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e261e2-0eea-4831-b24d-26aa51d77700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (aa6108c5-7c89-4ee0-988e-7ce8434666f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-601e1409-b4f2-4755-a395-c90b2b7b1edf tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created volume successfully. Nov 02 18:06:07 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 1073741824" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:07 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 Nov 02 18:06:07 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:07 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927816390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c03791-5f66-419b-ba4f-6cb5a8d45148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:05Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Creating volume 72c03791-5f66-419b-ba4f-6cb5a8d45148 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:07 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de633f8d-37ae-471c-b8d1-7d488782642d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24092726-9a4c-49e9-8932-be4d18679c77', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:07 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 1073741824 Nov 02 18:06:07 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530f52f2-5c57-4dc6-aad2-7ba7eed5ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:07 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Volume volume-24092726-9a4c-49e9-8932-be4d18679c77 (24092726-9a4c-49e9-8932-be4d18679c77): created successfully Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530f52f2-5c57-4dc6-aad2-7ba7eed5ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (59e70202-fce4-436e-9554-d9f3bc46247e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-74119cf4-d012-4881-b435-6385b71bc2c1 tempest-CreateVolumesFromImageTest-236403904 None] Created volume successfully. Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:08 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (98c8a3ad-770a-43de-9611-df0a8d6f4339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861e76e-6151-4ece-8e68-8590e21e0819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 1073741824" returned: 0 in 0.585s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3861e76e-6151-4ece-8e68-8590e21e0819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-56642590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa204c0d-0c55-436e-b3da-44cb36fde045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:08Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c9fcf-63e3-4432-8245-d5188024ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2c9fcf-63e3-4432-8245-d5188024ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99599e1e-40ca-4a15-a0fd-6b7436b84cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99599e1e-40ca-4a15-a0fd-6b7436b84cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa204c0d-0c55-436e-b3da-44cb36fde045', 'volume_name': 'volume-fa204c0d-0c55-436e-b3da-44cb36fde045', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71e00e0-6b6d-41a6-9aa7-02d8b6674eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e71e00e0-6b6d-41a6-9aa7-02d8b6674eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6eda7f-60d1-47a9-b006-52cf53b211d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume fa204c0d-0c55-436e-b3da-44cb36fde045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa204c0d-0c55-436e-b3da-44cb36fde045', 'volume_size': 1} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:08 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 Nov 02 18:06:08 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:08 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.490s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-657061465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f89acd9-6e88-4a68-91d1-d797d3865f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:06Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Creating volume 1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:08 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:08 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 1073741824 Nov 02 18:06:08 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14483896-a2da-4969-96cf-c52ca6b4fc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c03791-5f66-419b-ba4f-6cb5a8d45148', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd92d63-109e-4f94-a15a-8d164307b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (7f0a92d6-25e3-4479-979c-adbb7630059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95734624-ca73-4c8c-8869-44c57a98709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Volume volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 (72c03791-5f66-419b-ba4f-6cb5a8d45148): created successfully Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd92d63-109e-4f94-a15a-8d164307b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (17e6e83a-e531-4648-9e71-a3bc37277440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95734624-ca73-4c8c-8869-44c57a98709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1130651595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf0263e-10bd-4f06-9155-05aac654aab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:09Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ed3a01-71f8-4be9-99c2-8488d928f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ed3a01-71f8-4be9-99c2-8488d928f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d82f97-cb88-415f-99b5-d5ece314759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2d82f97-cb88-415f-99b5-d5ece314759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf0263e-10bd-4f06-9155-05aac654aab8', 'volume_name': 'volume-5bf0263e-10bd-4f06-9155-05aac654aab8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c64c604-62ec-4d47-bf78-1d3653fe9c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c64c604-62ec-4d47-bf78-1d3653fe9c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b82cfd9-f5b2-4548-a728-47b76a1cebf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume 5bf0263e-10bd-4f06-9155-05aac654aab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf0263e-10bd-4f06-9155-05aac654aab8', 'volume_size': 1} Nov 02 18:06:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:09 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cdf5cf9d-414c-422f-8246-1f9574171d1f tempest-CreateVolumesFromImageTest-236403904 None] Created volume successfully. Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (25fd74a8-ed91-493d-bebc-e38a5074025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd741c1-ec04-4c72-83de-8190c0c2b183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd741c1-ec04-4c72-83de-8190c0c2b183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1135768589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3a324a-e5a0-41bc-bc3c-b96a82f409af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:09Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cce7eb7-b3d7-418e-88b3-a30821d3252e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cce7eb7-b3d7-418e-88b3-a30821d3252e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1ddee2-73b6-4629-b8f6-fabdee0afda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1ddee2-73b6-4629-b8f6-fabdee0afda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3a324a-e5a0-41bc-bc3c-b96a82f409af', 'volume_name': 'volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b571f4e-9a92-4098-bb7e-4732ecd29e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b571f4e-9a92-4098-bb7e-4732ecd29e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752bdfff-d67e-4d8c-9e50-e417b7fae449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume 2c3a324a-e5a0-41bc-bc3c-b96a82f409af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af', 'volume_size': 1} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:09 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 1073741824" returned: 0 in 0.665s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:09 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 Nov 02 18:06:09 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:09 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.379s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-932820121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cce7630-7364-4ad9-bf41-05cd494ba3cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1253cfd31fa847e18a96222a0a08c0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:06Z,use_quota=True,user_id='be332fdc579842e58e2e3d7b34dff35b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Creating volume 5cce7630-7364-4ad9-bf41-05cd494ba3cc {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:09 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142922e0-8d0a-436f-949c-6f88876b206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f89acd9-6e88-4a68-91d1-d797d3865f86', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc 1073741824 Nov 02 18:06:09 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04614e0c-e23b-4079-801b-97d15ac9d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Volume volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 (1f89acd9-6e88-4a68-91d1-d797d3865f86): created successfully Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04614e0c-e23b-4079-801b-97d15ac9d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (0ac0337e-144b-4aa9-bf8c-fde30a6d7690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:09 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-548378e9-76ca-40ed-a6c9-54f14c9a7faa tempest-ProjectReaderTests-910942523 None] Created volume successfully. Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Flow 'volume_create_manager' (a077ebaf-b8aa-4655-8263-56156cc6b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66cd8fb-7e4d-42b1-a1bb-118f72663c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66cd8fb-7e4d-42b1-a1bb-118f72663c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1123d37-665d-468d-8bec-a5fe0be3b4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7894486df1174590a62628d795773d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:10Z,use_quota=True,user_id='eecfcf8fd69846d0b507ded92d3ad64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a6f0f8d-c7e5-48a2-95e0-aa00200c4c09),volume_type_id=8a6f0f8d-c7e5-48a2-95e0-aa00200c4c09)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47a6344-63a6-48b7-ab8d-f616ba382b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47a6344-63a6-48b7-ab8d-f616ba382b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ffee92-c3ef-4137-b2f2-bf84688b1639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:09 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (e58966b1-7554-4701-b9a9-589de3cfc78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4eb03c-c248-400b-94e4-5904f089684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (1d939f3b-2e4b-4c35-8e3b-99bd48926c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede21875-806e-4125-9e57-51fffd95b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4eb03c-c248-400b-94e4-5904f089684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-229246713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22750f62-c941-416e-ad2d-ae435cf7325c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:10Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad228f6-5c65-4d0d-9be5-a804ffb97209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad228f6-5c65-4d0d-9be5-a804ffb97209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad9087e-c823-4940-bc66-d792958d3b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad9087e-c823-4940-bc66-d792958d3b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22750f62-c941-416e-ad2d-ae435cf7325c', 'volume_name': 'volume-22750f62-c941-416e-ad2d-ae435cf7325c', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dca0b35-5614-40c8-800c-d104c5d34f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dca0b35-5614-40c8-800c-d104c5d34f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad14f4da-a480-4992-95ff-479544e1f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume 22750f62-c941-416e-ad2d-ae435cf7325c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22750f62-c941-416e-ad2d-ae435cf7325c', 'volume_size': 1} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:10 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede21875-806e-4125-9e57-51fffd95b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653123842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a46e7c-9025-459f-93af-01488a631779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:10Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c96d4e-9d82-4ede-9b90-0b93599aeba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c96d4e-9d82-4ede-9b90-0b93599aeba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25f3c09-5d28-42a5-b9c9-35c28dde451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25f3c09-5d28-42a5-b9c9-35c28dde451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7a46e7c-9025-459f-93af-01488a631779', 'volume_name': 'volume-e7a46e7c-9025-459f-93af-01488a631779', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab2b0a1-95a1-4f6c-b475-a027a41d817c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab2b0a1-95a1-4f6c-b475-a027a41d817c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147a335a-32d8-4136-8bc2-f84b742849ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume e7a46e7c-9025-459f-93af-01488a631779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7a46e7c-9025-459f-93af-01488a631779', 'volume_size': 1} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc 1073741824" returned: 0 in 0.579s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ffee92-c3ef-4137-b2f2-bf84688b1639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b1123d37-665d-468d-8bec-a5fe0be3b4b4', 'volume_name': 'volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4', 'volume_size': 1, 'image_id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3625dd8b-93be-4cbd-9b75-d984cd95e089', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f34b01b2f382e8a6dacf1ccbccbb9160', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7894486df1174590a62628d795773d32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43cc9f0ef82b566aded437a9e8b25b85690ff600b3fe806138383b14b245b8120945f9d24df4ce215d737a489d2ca999371f4d902a917580ac30cad5ae010fb1', 'id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'created_at': datetime.datetime(2026, 11, 2, 17, 6, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3625dd8b-93be-4cbd-9b75-d984cd95e089/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc Nov 02 18:06:10 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4feb027-079c-49ca-8706-e5c8cb6f593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4feb027-079c-49ca-8706-e5c8cb6f593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38f9394-ee70-4ae0-b4b4-d1e1a3dcdf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Volume b1123d37-665d-468d-8bec-a5fe0be3b4b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4', 'volume_size': 1, 'image_id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3625dd8b-93be-4cbd-9b75-d984cd95e089', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f34b01b2f382e8a6dacf1ccbccbb9160', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7894486df1174590a62628d795773d32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43cc9f0ef82b566aded437a9e8b25b85690ff600b3fe806138383b14b245b8120945f9d24df4ce215d737a489d2ca999371f4d902a917580ac30cad5ae010fb1', 'id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'created_at': datetime.datetime(2026, 11, 2, 17, 6, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3625dd8b-93be-4cbd-9b75-d984cd95e089/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Trying to clone b1123d37-665d-468d-8bec-a5fe0be3b4b4 from image 3625dd8b-93be-4cbd-9b75-d984cd95e089 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3625dd8b-93be-4cbd-9b75-d984cd95e089', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Image download 0.00 MB at 0.00 MB/s Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ed923-2c73-4e60-a923-561b1883d413]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:10 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.276s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-56642590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa204c0d-0c55-436e-b3da-44cb36fde045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:08Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Creating volume fa204c0d-0c55-436e-b3da-44cb36fde045 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c0cfef5-34b3-4897-a3d0-2df58be6f9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 1073741824 Nov 02 18:06:10 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b39b96-776e-4246-af32-265f25059492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:10 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD Nov 02 18:06:10 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Volume volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc (5cce7630-7364-4ad9-bf41-05cd494ba3cc): created successfully Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b39b96-776e-4246-af32-265f25059492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Flow 'volume_create_manager' (c15b83a2-5ff4-439e-bdd7-92ba301ea000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-70ae34d3-e3c0-456e-a1dd-651810b9d1bd tempest-CreateVolumesFromImageTest-236403904 None] Created volume successfully. Nov 02 18:06:10 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD Nov 02 18:06:11 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:11 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 1073741824" returned: 0 in 0.448s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 Nov 02 18:06:11 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:11 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Temporary image 3625dd8b-93be-4cbd-9b75-d984cd95e089 is fetched for user eecfcf8fd69846d0b507ded92d3ad64e. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e5e66-bf2b-4916-9851-7cb2bf8e611e]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045" returned: 0 in 0.248s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.386s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1130651595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf0263e-10bd-4f06-9155-05aac654aab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:09Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Creating volume 5bf0263e-10bd-4f06-9155-05aac654aab8 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:11 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b6eda7f-60d1-47a9-b006-52cf53b211d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa204c0d-0c55-436e-b3da-44cb36fde045', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:11 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 1073741824 Nov 02 18:06:11 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaa32b5-251a-4cac-bf52-ed0a4eb32ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:11 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume volume-fa204c0d-0c55-436e-b3da-44cb36fde045 (fa204c0d-0c55-436e-b3da-44cb36fde045): created successfully Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaa32b5-251a-4cac-bf52-ed0a4eb32ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (98c8a3ad-770a-43de-9611-df0a8d6f4339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:11 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD Nov 02 18:06:11 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:11 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e0cf3617-a571-40b6-8dde-c7df0a5d6bb5 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created volume successfully. Nov 02 18:06:11 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-5cce7630-7364-4ad9-bf41-05cd494ba3cc-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-5cce7630-7364-4ad9-bf41-05cd494ba3cc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-quobyte-5cce7630-7364-4ad9-bf41-05cd494ba3cc" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-5cce7630-7364-4ad9-bf41-05cd494ba3cc" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4bc1a-b07c-4795-8444-37c23251a0da]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD Nov 02 18:06:11 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:11 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 1073741824" returned: 0 in 0.500s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:11 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc Nov 02 18:06:11 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:11 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 Nov 02 18:06:11 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:12 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:12 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8" returned: 0 in 0.257s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1135768589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3a324a-e5a0-41bc-bc3c-b96a82f409af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:09Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Creating volume 2c3a324a-e5a0-41bc-bc3c-b96a82f409af {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:12 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:12 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc" returned: 0 in 0.426s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:12 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af 1073741824 Nov 02 18:06:12 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b82cfd9-f5b2-4548-a728-47b76a1cebf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf0263e-10bd-4f06-9155-05aac654aab8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3867ce-1b96-4558-b488-a9f1fe4f841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:12 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc Nov 02 18:06:12 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:12 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume volume-5bf0263e-10bd-4f06-9155-05aac654aab8 (5bf0263e-10bd-4f06-9155-05aac654aab8): created successfully Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3867ce-1b96-4558-b488-a9f1fe4f841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (7f0a92d6-25e3-4479-979c-adbb7630059c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f96b782d-69d5-42d2-8cef-332744dbfc0c tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created volume successfully. Nov 02 18:06:12 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5cce7630-7364-4ad9-bf41-05cd494ba3cc" returned: 0 in 0.303s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-5cce7630-7364-4ad9-bf41-05cd494ba3cc" released by "delete_volume" :: held 0.780s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Created reservations ['2726b802-99dd-4a90-bc04-65df2456895c', '88ef99e2-f5ba-40f8-a449-ab5926560fdd', '22563664-63f1-439c-add5-9caf9f8b673b', '48b4228b-c034-4bc5-b0b6-d782db393e14'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:12 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:12 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:12 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af 1073741824" returned: 0 in 0.518s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:12 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af Nov 02 18:06:12 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-72c03791-5f66-419b-ba4f-6cb5a8d45148-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-72c03791-5f66-419b-ba4f-6cb5a8d45148-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-quobyte-72c03791-5f66-419b-ba4f-6cb5a8d45148" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-72c03791-5f66-419b-ba4f-6cb5a8d45148" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:13 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.328s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fca133-1021-4870-8bc3-931cd1aa6260]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Deleted volume successfully. Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bc4f0b9-1319-430a-b54d-0c5c292eeec3 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-5cce7630-7364-4ad9-bf41-05cd494ba3cc-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:13 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af" returned: 0 in 0.334s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.868s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-229246713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22750f62-c941-416e-ad2d-ae435cf7325c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:10Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Creating volume 22750f62-c941-416e-ad2d-ae435cf7325c {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (752bdfff-d67e-4d8c-9e50-e417b7fae449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5410801-5bd9-425c-bd0f-83189e90e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:13 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c 1073741824 Nov 02 18:06:13 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:13 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 Nov 02 18:06:13 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af (2c3a324a-e5a0-41bc-bc3c-b96a82f409af): created successfully Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5410801-5bd9-425c-bd0f-83189e90e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (25fd74a8-ed91-493d-bebc-e38a5074025c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5e9aafff-7ded-4afc-83bd-53153c002d20 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created volume successfully. Nov 02 18:06:13 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148" returned: 0 in 0.389s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:13 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148 Nov 02 18:06:13 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:13 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c 1073741824" returned: 0 in 0.446s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:13 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c Nov 02 18:06:13 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:13 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-72c03791-5f66-419b-ba4f-6cb5a8d45148" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-72c03791-5f66-419b-ba4f-6cb5a8d45148" released by "delete_volume" :: held 0.728s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Created reservations ['2446b0b4-fc60-4dae-b3d7-1a7b74cac961', '28224ae5-759d-4352-9982-cf6b7052d3b8', '9a0a5311-4e25-4023-9b23-aea80215a48e', '5fde2183-aa7f-43f0-b9f2-cd92e4d5728d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:13 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c" returned: 0 in 0.244s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:13 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:13 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1653123842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7a46e7c-9025-459f-93af-01488a631779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d5a252d5db543ffb5450c5449b16f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:10Z,use_quota=True,user_id='1966da77365c4108bd632d9a9e3ad34c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Creating volume e7a46e7c-9025-459f-93af-01488a631779 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad14f4da-a480-4992-95ff-479544e1f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22750f62-c941-416e-ad2d-ae435cf7325c', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:13 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 1073741824 Nov 02 18:06:13 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e3691d-9fb8-41ac-8911-a40a46fb2f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume volume-22750f62-c941-416e-ad2d-ae435cf7325c (22750f62-c941-416e-ad2d-ae435cf7325c): created successfully Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e3691d-9fb8-41ac-8911-a40a46fb2f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:13 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (e58966b1-7554-4701-b9a9-589de3cfc78e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:13 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-51a76d5b-0206-435a-b2a9-4603fddbc3eb tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created volume successfully. Nov 02 18:06:14 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.252s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Deleted volume successfully. Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-24092726-9a4c-49e9-8932-be4d18679c77-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33f2373c-7865-4a65-9ab3-8c9da2be64bf tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-72c03791-5f66-419b-ba4f-6cb5a8d45148-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-24092726-9a4c-49e9-8932-be4d18679c77-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-quobyte-24092726-9a4c-49e9-8932-be4d18679c77" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-24092726-9a4c-49e9-8932-be4d18679c77" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e895ffa8-08a9-4c2c-9eaf-a10223c3ac24]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:14 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 Nov 02 18:06:14 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:14 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 1073741824" returned: 0 in 0.515s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:14 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 Nov 02 18:06:14 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:14 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:14 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77 Nov 02 18:06:14 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:14 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.291s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147a335a-32d8-4136-8bc2-f84b742849ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7a46e7c-9025-459f-93af-01488a631779', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336dfd4-edb4-43c4-9778-f90f740d555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Creating offline snapshot af0c0026-7feb-4c7b-8830-3c295b816094 of volume 1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:14 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Volume volume-e7a46e7c-9025-459f-93af-01488a631779 (e7a46e7c-9025-459f-93af-01488a631779): created successfully Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4336dfd4-edb4-43c4-9778-f90f740d555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Flow 'volume_create_manager' (1d939f3b-2e4b-4c35-8e3b-99bd48926c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[26757ac5-6332-4233-a803-d4194f9d1416]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:14 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0924d2fa-00bd-4043-9508-2a9494f15a72 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created volume successfully. Nov 02 18:06:14 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-24092726-9a4c-49e9-8932-be4d18679c77" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-24092726-9a4c-49e9-8932-be4d18679c77" released by "delete_volume" :: held 0.686s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:14 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 Nov 02 18:06:14 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Created reservations ['e978e29a-f1c2-4a24-8c9d-2dec30ed046e', '74f8d2ae-2cf0-4f9b-9bc6-e0600c994865', 'b5ee7760-4e8b-4992-b09a-47ad0b04a32c', 'ded75f23-5f74-4437-b182-efeb05ee3eca'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:15 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:15 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:15 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86" returned: 0 in 0.381s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:15 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 1G Nov 02 18:06:15 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:15 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Deleted volume successfully. Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-2f1ea678-5407-44db-8305-5978760f8b41-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3921772a-2b47-4960-ab6b-e3b272b5d471 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-24092726-9a4c-49e9-8932-be4d18679c77-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-2f1ea678-5407-44db-8305-5978760f8b41-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-quobyte-2f1ea678-5407-44db-8305-5978760f8b41" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-2f1ea678-5407-44db-8305-5978760f8b41" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[026e64f0-0967-45b0-a860-79595426788e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-e7a46e7c-9025-459f-93af-01488a631779-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-e7a46e7c-9025-459f-93af-01488a631779-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:15 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 Nov 02 18:06:15 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-quobyte-e7a46e7c-9025-459f-93af-01488a631779" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-e7a46e7c-9025-459f-93af-01488a631779" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d718bb-5128-435e-9160-3efe7f1c1401]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:15 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 1G" returned: 0 in 0.550s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:15 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 Nov 02 18:06:15 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:15 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 Nov 02 18:06:15 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:15 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41" returned: 0 in 0.475s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:15 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41 Nov 02 18:06:15 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094" returned: 0 in 0.340s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 is being set with open permissions: ugo+rw Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779 Nov 02 18:06:16 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 Nov 02 18:06:16 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2f1ea678-5407-44db-8305-5978760f8b41" returned: 0 in 0.266s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-2f1ea678-5407-44db-8305-5978760f8b41" released by "delete_volume" :: held 0.794s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Created reservations ['4345c6ee-ad6b-4ed5-a32b-da4a63e2f3f4', '277a9850-c2e2-4898-98fd-58e4b3bb95bb', '8eddaf48-a05f-481e-a0d6-60baf82be3ad', 'c1ee4e00-a04c-4b37-acb8-fe83deb3cd9f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094" returned: 0 in 0.256s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-e7a46e7c-9025-459f-93af-01488a631779" returned: 0 in 0.281s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:16 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-e7a46e7c-9025-459f-93af-01488a631779" released by "delete_volume" :: held 0.744s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info Nov 02 18:06:16 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created reservations ['414ef59c-e3e0-4779-b038-e36a8942085e', 'd5a66faf-40b5-4e17-b0c1-da193d012301', 'bdc80a4e-4cff-442d-89ad-ca48097af5cc', '93b92e5d-32e8-454c-a439-d584afa2e92d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:16 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:16 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.308s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Deleted volume successfully. Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "cinder-quobyte-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-76d43218-e2e1-4e68-af14-a1e803fb1df1 tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-2f1ea678-5407-44db-8305-5978760f8b41-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb30408-eba8-43c0-bcff-e67f9c4e301b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info" returned: 0 in 0.360s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info is being set with open permissions: ugo+rw Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-22750f62-c941-416e-ad2d-ae435cf7325c-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-22750f62-c941-416e-ad2d-ae435cf7325c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:16 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info Nov 02 18:06:16 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-quobyte-22750f62-c941-416e-ad2d-ae435cf7325c" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-22750f62-c941-416e-ad2d-ae435cf7325c" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:16 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.346s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Deleted volume successfully. Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[707f6d7e-ff63-4149-8402-72af5000d4cc]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:16 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a Nov 02 18:06:16 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-cce2209e-59d1-404b-9a58-a4daa5db6a08 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-e7a46e7c-9025-459f-93af-01488a631779-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:17 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.info" returned: 0 in 0.292s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:17 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.964s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1123d37-665d-468d-8bec-a5fe0be3b4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7894486df1174590a62628d795773d32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:10Z,use_quota=True,user_id='eecfcf8fd69846d0b507ded92d3ad64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a6f0f8d-c7e5-48a2-95e0-aa00200c4c09),volume_type_id=8a6f0f8d-c7e5-48a2-95e0-aa00200c4c09)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Creating volume b1123d37-665d-468d-8bec-a5fe0be3b4b4 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:17 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:17 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 1073741824 Nov 02 18:06:17 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4d6d6820-a37a-4396-9568-5c1ad2892a92 tempest-ProjectReaderTests-910942523 None] Create snapshot completed successfully Nov 02 18:06:17 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a" returned: 0 in 0.493s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:17 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a Nov 02 18:06:17 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:17 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c Nov 02 18:06:17 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a" returned: 0 in 0.264s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-quobyte-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a" released by "delete_volume" :: held 0.807s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:17 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 1073741824" returned: 0 in 0.465s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Created reservations ['b7ce18f6-7f59-41b0-b2df-c95f08bcdd8f', '3e2e0d3e-b47f-4b3a-8be6-d4da9aab8ae2', '58521cd2-1370-43fd-b04b-f3edb58d1003', 'be21d1f4-0785-44ef-b8ef-332de0e318a0'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:17 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-22750f62-c941-416e-ad2d-ae435cf7325c" returned: 0 in 0.270s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-22750f62-c941-416e-ad2d-ae435cf7325c" released by "delete_volume" :: held 0.760s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:17 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 Nov 02 18:06:17 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:17 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:17 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created reservations ['c9ca99a7-14c3-48ce-a522-19c9a8b3291d', '5359a3ea-16b6-4755-9f18-f351a60729d0', 'd499c66c-682e-4043-a738-d798b886cd1d', 'fffead31-85cd-4658-a650-977e875a73ef'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:17 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:17 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4" returned: 0 in 0.342s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:17 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-af0c0026-7feb-4c7b-8830-3c295b816094-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Lock "cinder-af0c0026-7feb-4c7b-8830-3c295b816094-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:17 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-1f89acd9-6e88-4a68-91d1-d797d3865f86" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Attempting download of 3625dd8b-93be-4cbd-9b75-d984cd95e089 ((None, [{'url': 'file:///opt/stack/data/glance/images/3625dd8b-93be-4cbd-9b75-d984cd95e089', 'metadata': {}}])) to volume b1123d37-665d-468d-8bec-a5fe0be3b4b4. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-2c3a324a-e5a0-41bc-bc3c-b96a82f409af-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-1f89acd9-6e88-4a68-91d1-d797d3865f86" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-af0c0026-7feb-4c7b-8830-3c295b816094" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-2c3a324a-e5a0-41bc-bc3c-b96a82f409af-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-af0c0026-7feb-4c7b-8830-3c295b816094" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Deleting offline snapshot af0c0026-7feb-4c7b-8830-3c295b816094 of volume 1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:18 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] snapshot_file for this snap is: volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Deleted volume successfully. Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e551d3e-2e5a-4326-8c31-c89ddb5b83ee]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3313b7d-536d-421c-a263-1e2e77906aed]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-quobyte-2c3a324a-e5a0-41bc-bc3c-b96a82f409af" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-760cf457-5c99-4eb4-a258-dd0750ba205b tempest-CreateVolumesFromImageTest-236403904 None] Lock "cinder-7cd63443-fcf3-453d-b2c2-b2bc5356bd4a-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-2c3a324a-e5a0-41bc-bc3c-b96a82f409af" acquired by "delete_volume" :: waited 0.036s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[208c5493-1315-478c-b6ce-81680fe2e065]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:18 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 Nov 02 18:06:18 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:18 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.554s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Deleted volume successfully. Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c246a2f2-3085-48b1-814b-fecc7c82706d tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-22750f62-c941-416e-ad2d-ae435cf7325c-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:18 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk Nov 02 18:06:18 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:18 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af Nov 02 18:06:18 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:18 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk" returned: 0 in 0.519s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:18 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094" returned: 0 in 0.591s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f89acd9-6e88-4a68-91d1-d797d3865f86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14c9ae6-f619-4cd2-add7-74f786a32ecd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:18 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk Nov 02 18:06:18 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:18 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:18 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 Nov 02 18:06:18 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af" returned: 0 in 0.566s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:18 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af Nov 02 18:06:18 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:19 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk" returned: 1 in 0.447s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3625dd8b-93be-4cbd-9b75-d984cd95e089_wsg7n_hk' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[90827f50-bd00-405e-a5cf-dea6b9f85086]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:19 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86" returned: 0 in 0.494s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:19 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2c3a324a-e5a0-41bc-bc3c-b96a82f409af" returned: 0 in 0.375s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:19 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD Nov 02 18:06:19 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:19 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 Nov 02 18:06:19 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-2c3a324a-e5a0-41bc-bc3c-b96a82f409af" released by "delete_volume" :: held 1.054s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created reservations ['6ffafba8-f30e-44b5-9be0-a37e2790c205', '44268c48-be5a-4df7-893a-3a0b03e11158', '0017b5a0-8aa7-4f95-9f0c-e9eed381d0cb', '8fe4d0a0-0943-48aa-beca-3e34fb9abd47'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:19 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:19 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:19 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:19 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD Nov 02 18:06:19 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:19 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094" returned: 0 in 0.497s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:19 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.300s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Deleted volume successfully. Nov 02 18:06:19 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094 Nov 02 18:06:19 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:19 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5ef11370-3a1a-4b75-8c9c-e7d7f3a32b48 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-2c3a324a-e5a0-41bc-bc3c-b96a82f409af-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:20 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] 3625dd8b-93be-4cbd-9b75-d984cd95e089 was raw, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:20 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 Nov 02 18:06:20 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:20 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86.af0c0026-7feb-4c7b-8830-3c295b816094" returned: 0 in 0.291s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-af0c0026-7feb-4c7b-8830-3c295b816094" released by "_delete_snapshot" :: held 2.076s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-1f89acd9-6e88-4a68-91d1-d797d3865f86" released by "delete_snapshot" :: held 2.119s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Created reservations ['5deaa305-8f9a-4e90-b408-a1d42ff2fd90', '1125687f-ecd3-42e8-9b8e-03542ffbf282', '27fa6382-953e-4889-a5f7-7659f72c7f7a', '42772bc0-aaf3-4f62-92fb-974fb5b2fc55'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:20 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Delete snapshot completed successfully. Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-6ece40f3-56ef-46d4-9cb0-887ee2b3052e tempest-ProjectReaderTests-910942523 None] Lock "cinder-af0c0026-7feb-4c7b-8830-3c295b816094-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-5bf0263e-10bd-4f06-9155-05aac654aab8-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-5bf0263e-10bd-4f06-9155-05aac654aab8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-quobyte-5bf0263e-10bd-4f06-9155-05aac654aab8" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-5bf0263e-10bd-4f06-9155-05aac654aab8" acquired by "delete_volume" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7645ad85-a7a8-486f-b4b0-b34b3b52cfad]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:20 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4" returned: 0 in 0.594s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3625dd8b-93be-4cbd-9b75-d984cd95e089_g3t7ywbodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:06:20 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:20 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 Nov 02 18:06:20 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:20 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 1G Nov 02 18:06:20 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:20 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8" returned: 0 in 0.412s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:20 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8 Nov 02 18:06:20 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:20 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 1G" returned: 0 in 0.358s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Downloaded image 3625dd8b-93be-4cbd-9b75-d984cd95e089 ((None, [{'url': 'file:///opt/stack/data/glance/images/3625dd8b-93be-4cbd-9b75-d984cd95e089', 'metadata': {}}])) to volume b1123d37-665d-468d-8bec-a5fe0be3b4b4 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Temporary image 3625dd8b-93be-4cbd-9b75-d984cd95e089 for user eecfcf8fd69846d0b507ded92d3ad64e is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 18:06:20 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Marking volume b1123d37-665d-468d-8bec-a5fe0be3b4b4 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Copying metadata from image 3625dd8b-93be-4cbd-9b75-d984cd95e089 to b1123d37-665d-468d-8bec-a5fe0be3b4b4. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Creating volume glance metadata for volume b1123d37-665d-468d-8bec-a5fe0be3b4b4 backed by image 3625dd8b-93be-4cbd-9b75-d984cd95e089 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f34b01b2f382e8a6dacf1ccbccbb9160', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38f9394-ee70-4ae0-b4b4-d1e1a3dcdf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4', 'volume_size': 1, 'image_id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3625dd8b-93be-4cbd-9b75-d984cd95e089', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f34b01b2f382e8a6dacf1ccbccbb9160', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7894486df1174590a62628d795773d32', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '43cc9f0ef82b566aded437a9e8b25b85690ff600b3fe806138383b14b245b8120945f9d24df4ce215d737a489d2ca999371f4d902a917580ac30cad5ae010fb1', 'id': '3625dd8b-93be-4cbd-9b75-d984cd95e089', 'created_at': datetime.datetime(2026, 11, 2, 17, 6, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 6, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3625dd8b-93be-4cbd-9b75-d984cd95e089/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cb8584-7dcd-4f06-b81d-f8a30f763be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Volume volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 (b1123d37-665d-468d-8bec-a5fe0be3b4b4): created successfully Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cb8584-7dcd-4f06-b81d-f8a30f763be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Flow 'volume_create_manager' (a077ebaf-b8aa-4655-8263-56156cc6b39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:21 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b0db409f-fc97-437d-a326-b0804516069f tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Created volume successfully. Nov 02 18:06:21 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-1f89acd9-6e88-4a68-91d1-d797d3865f86-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5bf0263e-10bd-4f06-9155-05aac654aab8" returned: 0 in 0.281s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-5bf0263e-10bd-4f06-9155-05aac654aab8" released by "delete_volume" :: held 0.750s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Lock "cinder-1f89acd9-6e88-4a68-91d1-d797d3865f86-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-1f89acd9-6e88-4a68-91d1-d797d3865f86" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-1f89acd9-6e88-4a68-91d1-d797d3865f86" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created reservations ['ea683281-f87e-43bd-9545-d5af225a9edb', '475aa9f6-8de2-4b83-a019-0d96de873e35', '8fa41a28-3288-495e-99f4-86039e319b1e', '8cdacc6d-002a-4c6f-8df4-a9b76274e09d'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f941b-ebb9-42ac-98a5-6c0b637e5764]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:21 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 Nov 02 18:06:21 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Acquiring lock "cinder-b1123d37-665d-468d-8bec-a5fe0be3b4b4-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:21 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:21 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "cinder-b1123d37-665d-468d-8bec-a5fe0be3b4b4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-fa204c0d-0c55-436e-b3da-44cb36fde045-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Acquiring lock "cinder-quobyte-b1123d37-665d-468d-8bec-a5fe0be3b4b4" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-fa204c0d-0c55-436e-b3da-44cb36fde045-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "cinder-quobyte-b1123d37-665d-468d-8bec-a5fe0be3b4b4" acquired by "delete_volume" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00400a2-2843-4358-9474-e2db932f3ed3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-quobyte-fa204c0d-0c55-436e-b3da-44cb36fde045" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:21 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (e719627e-7a0d-41f0-be46-73517df07042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675a1b32-65c3-46b5-9b00-9f13c059c444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-fa204c0d-0c55-436e-b3da-44cb36fde045" acquired by "delete_volume" :: waited 0.068s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86" returned: 0 in 0.530s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:21 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 Nov 02 18:06:21 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675a1b32-65c3-46b5-9b00-9f13c059c444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2086386134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172d1d6e-275c-4164-9b27-319e2ac93abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:22Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:21 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9e4731-47d3-4cf7-b3e6-e537f8cff68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9e4731-47d3-4cf7-b3e6-e537f8cff68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:21 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86 Nov 02 18:06:21 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b916d69c-14a1-4c22-b632-9270fb849d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b916d69c-14a1-4c22-b632-9270fb849d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172d1d6e-275c-4164-9b27-319e2ac93abf', 'volume_name': 'volume-172d1d6e-275c-4164-9b27-319e2ac93abf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec306661-d7a2-466e-8534-771d7b722d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec306661-d7a2-466e-8534-771d7b722d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c404fb-5e43-4faf-9488-9eb51b7f13b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:21 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume 172d1d6e-275c-4164-9b27-319e2ac93abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172d1d6e-275c-4164-9b27-319e2ac93abf', 'volume_size': 1} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2086386134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172d1d6e-275c-4164-9b27-319e2ac93abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:22Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating volume 172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:21 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321676c-fcfc-4591-930b-9fab927b2b17]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.485s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:22 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf 1073741824 Nov 02 18:06:22 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Deleted volume successfully. Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b06b49af-9a00-40a6-bb63-e7f3e137d76a tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-5bf0263e-10bd-4f06-9155-05aac654aab8-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:22 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 Nov 02 18:06:22 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4" returned: 0 in 0.420s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:22 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4 Nov 02 18:06:22 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1f89acd9-6e88-4a68-91d1-d797d3865f86" returned: 0 in 0.338s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-1f89acd9-6e88-4a68-91d1-d797d3865f86" released by "delete_volume" :: held 0.952s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Created reservations ['cde6ca15-481f-4741-8eff-69898a75beb6', 'fd1203f4-e52e-4509-959f-69da0a0f4412', '050bbc8d-2baf-4456-ad77-315628670b46', 'd0737085-4818-49df-a878-318dbfb9e73c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:22 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:22 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045" returned: 0 in 0.519s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:22 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf 1073741824" returned: 0 in 0.548s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045 Nov 02 18:06:22 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:22 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf Nov 02 18:06:22 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b1123d37-665d-468d-8bec-a5fe0be3b4b4" returned: 0 in 0.502s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "cinder-quobyte-b1123d37-665d-468d-8bec-a5fe0be3b4b4" released by "delete_volume" :: held 0.992s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Created reservations ['b35246ce-0d41-429c-8aaa-7bf616269d46', 'a9a3b763-9fcb-4f05-ab85-222ceeb81dd3', '00fef401-95c9-461d-9f7d-ec187c51fa16', '2fcd35f9-32dd-4171-bffd-dc243bff5ac9'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:22 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.438s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:22 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Deleted volume successfully. Nov 02 18:06:22 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fa204c0d-0c55-436e-b3da-44cb36fde045" returned: 0 in 0.372s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4ae63f9d-d864-4472-bc26-2ed8ca8a42b1 tempest-ProjectReaderTests-910942523 None] Lock "cinder-1f89acd9-6e88-4a68-91d1-d797d3865f86-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-fa204c0d-0c55-436e-b3da-44cb36fde045" released by "delete_volume" :: held 1.016s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:22 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf" returned: 0 in 0.384s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:22 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:22 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c404fb-5e43-4faf-9488-9eb51b7f13b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172d1d6e-275c-4164-9b27-319e2ac93abf', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995a8e95-5e33-450e-9450-f6ac67b905bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:22 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume volume-172d1d6e-275c-4164-9b27-319e2ac93abf (172d1d6e-275c-4164-9b27-319e2ac93abf): created successfully Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (995a8e95-5e33-450e-9450-f6ac67b905bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:22 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (e719627e-7a0d-41f0-be46-73517df07042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8777c671-0565-4ced-861c-36fe0355ffd1 tempest-CreateVolumesFromSnapshotTest-438153289 None] Created volume successfully. Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created reservations ['f3fd1de2-b5b5-4c96-8c9f-8f327664f8a8', 'b71542f8-efae-4f56-aae0-dd1e3f3a0f2f', '62d14565-70a5-4ac9-8d54-64a6067fd9f0', 'eac7d975-caca-4bdd-8ac6-e2b179ea8125'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:23 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:23 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:23 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.286s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (7e859fae-66a2-43fe-8e27-2509d1c6636f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59c293c-77e5-40ed-8bed-895908adfcf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Deleted volume successfully. Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59c293c-77e5-40ed-8bed-895908adfcf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895685946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e8f084-d348-49ce-af72-93f288058e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:23Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31c60b6-114f-4db8-af0d-0205737d1055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31c60b6-114f-4db8-af0d-0205737d1055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa49882-408a-4cee-b125-5f594f68c44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa49882-408a-4cee-b125-5f594f68c44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23e8f084-d348-49ce-af72-93f288058e2b', 'volume_name': 'volume-23e8f084-d348-49ce-af72-93f288058e2b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c23613-1325-48b3-bb31-64423bcab344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17c23613-1325-48b3-bb31-64423bcab344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8261a33-a9d6-481d-9b74-03d9c7112734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:23 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Volume 23e8f084-d348-49ce-af72-93f288058e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23e8f084-d348-49ce-af72-93f288058e2b', 'volume_size': 1} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-895685946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e8f084-d348-49ce-af72-93f288058e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:23Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Creating volume 23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:23 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-40a44046-71ca-42a0-b37d-5bc66a6cfeff tempest-VolumeAndVolumeTypeFromImageTest-1448369335 None] Lock "cinder-b1123d37-665d-468d-8bec-a5fe0be3b4b4-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:23 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b 1073741824 Nov 02 18:06:23 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:23 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Deleted volume successfully. Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b96730a2-bd9e-46e9-8a24-3568cd8a86e4 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-fa204c0d-0c55-436e-b3da-44cb36fde045-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:23 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b 1073741824" returned: 0 in 0.432s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:23 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b Nov 02 18:06:23 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-717a5b97-37f6-4c8c-a58a-9a0bd834a306-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-717a5b97-37f6-4c8c-a58a-9a0bd834a306-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "cinder-quobyte-717a5b97-37f6-4c8c-a58a-9a0bd834a306" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:24 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b" returned: 0 in 0.324s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.057s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-717a5b97-37f6-4c8c-a58a-9a0bd834a306" acquired by "delete_volume" :: waited 0.038s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating offline snapshot 8141c346-f8e4-4d11-8594-a9ba9e19d86c of volume 172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8261a33-a9d6-481d-9b74-03d9c7112734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e8f084-d348-49ce-af72-93f288058e2b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee994033-4db5-4369-9b77-d17c4ccfbe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[061f8326-9edf-4741-980d-cd1af77c62cd]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2024b11-e79e-4274-8e79-4797ebe9a20d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Volume volume-23e8f084-d348-49ce-af72-93f288058e2b (23e8f084-d348-49ce-af72-93f288058e2b): created successfully Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee994033-4db5-4369-9b77-d17c4ccfbe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (7e859fae-66a2-43fe-8e27-2509d1c6636f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-94b4c6a8-fcba-4350-9a80-2b2076f59540 tempest-ProjectReaderTests-910942523 None] Created volume successfully. Nov 02 18:06:24 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf Nov 02 18:06:24 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:24 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 Nov 02 18:06:24 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:24 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:24 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c 1G Nov 02 18:06:24 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:24 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306" returned: 0 in 0.525s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:24 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306 Nov 02 18:06:24 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:24 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-717a5b97-37f6-4c8c-a58a-9a0bd834a306" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-quobyte-717a5b97-37f6-4c8c-a58a-9a0bd834a306" released by "delete_volume" :: held 0.882s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Created reservations ['5b0bad30-2b7d-4288-b212-db1895b5d27f', '6f750c5f-e463-47cb-ada6-12b6645f96a5', '3a485cc0-cb67-4216-b7b8-6cf3bd793a93', 'b5014b56-5114-4bbc-b30b-9c0c785331ad'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:25 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:25 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:25 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c 1G" returned: 0 in 0.543s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172d1d6e-275c-4164-9b27-319e2ac93abf -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:25 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172d1d6e-275c-4164-9b27-319e2ac93abf -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c Nov 02 18:06:25 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:25 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.382s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Deleted volume successfully. Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c6aae30-7d27-4503-8d66-ff916e3a9ba8 tempest-CreateVolumesFromSourceVolumeTest-115130147 None] Lock "cinder-717a5b97-37f6-4c8c-a58a-9a0bd834a306-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:25 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172d1d6e-275c-4164-9b27-319e2ac93abf -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c" returned: 0 in 0.505s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:25 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c is being set with open permissions: ugo+rw Nov 02 18:06:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:25 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c Nov 02 18:06:25 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:26 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:26 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info Nov 02 18:06:26 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:26 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info" returned: 0 in 0.323s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:26 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info is being set with open permissions: ugo+rw Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:26 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info Nov 02 18:06:26 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:26 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.info" returned: 0 in 0.293s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.619s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.156s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Creating offline snapshot d098ef48-059c-47ab-adbe-4af0778196fe of volume 23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c855dc94-fee0-43dc-92ab-227e0e723c86]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d957b0e2-1953-4055-bda1-de8409825321 tempest-CreateVolumesFromSnapshotTest-438153289 None] Create snapshot completed successfully Nov 02 18:06:26 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b Nov 02 18:06:26 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:27 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b" returned: 0 in 0.482s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:27 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe 1G Nov 02 18:06:27 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (059b4d46-2fad-41ff-9b39-570b82c2551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415058ee-ad54-49b5-8127-adc2dae5e837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:27 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe 1G" returned: 0 in 0.652s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e8f084-d348-49ce-af72-93f288058e2b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415058ee-ad54-49b5-8127-adc2dae5e837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1507690513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4f8560-e643-46cf-8aff-ab9f40a4160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:28Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066a96f9-3ee4-478e-bc11-8127f5e549fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066a96f9-3ee4-478e-bc11-8127f5e549fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e66e8fa-4f32-433a-b4b3-4013b0c2147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e66e8fa-4f32-433a-b4b3-4013b0c2147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4f8560-e643-46cf-8aff-ab9f40a4160e', 'volume_name': 'volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:27 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e8f084-d348-49ce-af72-93f288058e2b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587a478a-f6ea-4b83-b4e7-8955d62e20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:27 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (587a478a-f6ea-4b83-b4e7-8955d62e20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223e8b5c-c461-4ecb-b0b8-99aa025ae42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume 6d4f8560-e643-46cf-8aff-ab9f40a4160e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e', 'volume_size': 1} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:28 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23e8f084-d348-49ce-af72-93f288058e2b -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe" returned: 0 in 0.457s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:28 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe is being set with open permissions: ugo+rw Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:28 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe Nov 02 18:06:28 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (0ea7ac3a-6b5f-4498-930d-8bbc3eccbe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2fe792-96d1-48a7-9e60-8abf822fcd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2fe792-96d1-48a7-9e60-8abf822fcd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1729400561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e96d976-1cca-43a9-ae64-db25756c524b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:28Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72028f04-6198-4159-9269-359a95b6ecfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72028f04-6198-4159-9269-359a95b6ecfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577ac00d-6a9f-4051-b351-4a2e61991d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577ac00d-6a9f-4051-b351-4a2e61991d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e96d976-1cca-43a9-ae64-db25756c524b', 'volume_name': 'volume-1e96d976-1cca-43a9-ae64-db25756c524b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5aa5491-2369-47e3-b8dd-963a3ea43266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5aa5491-2369-47e3-b8dd-963a3ea43266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3925f7-1f6c-467e-9fe8-aa20c39c6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume 1e96d976-1cca-43a9-ae64-db25756c524b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e96d976-1cca-43a9-ae64-db25756c524b', 'volume_size': 1} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:28 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe" returned: 0 in 0.362s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:28 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info Nov 02 18:06:28 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (782bfa16-d890-4131-b645-2d1bc7f40a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36685955-a1d4-4bab-9a37-012b3d8d8bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36685955-a1d4-4bab-9a37-012b3d8d8bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-479806742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5edc189-9668-4e63-9caf-07b32d225a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:29Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4f6202-8108-46b2-88fa-b9071d88d798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4f6202-8108-46b2-88fa-b9071d88d798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a560d129-964e-47c2-9e94-ee674a191fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a560d129-964e-47c2-9e94-ee674a191fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5edc189-9668-4e63-9caf-07b32d225a10', 'volume_name': 'volume-b5edc189-9668-4e63-9caf-07b32d225a10', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3023b7-562d-4e0f-b761-45ba2f2c0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3023b7-562d-4e0f-b761-45ba2f2c0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de469d-f650-48d6-b369-05286f95fd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume b5edc189-9668-4e63-9caf-07b32d225a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5edc189-9668-4e63-9caf-07b32d225a10', 'volume_size': 1} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:29 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info" returned: 0 in 0.423s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:29 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info is being set with open permissions: ugo+rw Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:29 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info Nov 02 18:06:29 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:29 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.info" returned: 0 in 0.281s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.788s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1507690513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4f8560-e643-46cf-8aff-ab9f40a4160e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:28Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating volume 6d4f8560-e643-46cf-8aff-ab9f40a4160e {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:29 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:29 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e 1073741824 Nov 02 18:06:29 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-485f7430-fd35-444f-9a2d-10f92cf7b391 tempest-ProjectReaderTests-910942523 None] Create snapshot completed successfully Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (22b2534a-130a-4156-b8f5-bbd7ac3f9aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd37223f-2643-436f-9b63-c9bd2e039b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd37223f-2643-436f-9b63-c9bd2e039b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306811349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361bf32b-deb4-490e-9dd7-0b4e8862da8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468d6273-6ca2-450b-ac03-6fe0b1389f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468d6273-6ca2-450b-ac03-6fe0b1389f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4d9434-d2e6-4439-b895-0b2eece8bdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4d9434-d2e6-4439-b895-0b2eece8bdb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361bf32b-deb4-490e-9dd7-0b4e8862da8a', 'volume_name': 'volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6ddf58-8d38-4847-9e64-ffa16a476596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6ddf58-8d38-4847-9e64-ffa16a476596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1839a7-5015-42a5-8f4a-f3b6bedb103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume 361bf32b-deb4-490e-9dd7-0b4e8862da8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a', 'volume_size': 1} Nov 02 18:06:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-d098ef48-059c-47ab-adbe-4af0778196fe-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Lock "cinder-d098ef48-059c-47ab-adbe-4af0778196fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-23e8f084-d348-49ce-af72-93f288058e2b" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Flow 'volume_create_manager' (00c04836-11fb-4639-b592-69904d2e12e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8902bec-b0ca-4c02-ae4e-e1a8e98273d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8902bec-b0ca-4c02-ae4e-e1a8e98273d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c656d1-bc25-46bd-92e6-582fce049366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d711e379da4b4d9a887872af4381a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='63a371435e3843d282a87c12dc043790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072a499a-a210-4e61-9b5a-4a04e695a4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072a499a-a210-4e61-9b5a-4a04e695a4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b141201-c3d2-40c1-9394-9b02a0c78240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b141201-c3d2-40c1-9394-9b02a0c78240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c656d1-bc25-46bd-92e6-582fce049366', 'volume_name': 'volume-67c656d1-bc25-46bd-92e6-582fce049366', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a272781-94f0-47d9-a8d8-3e2ed792060f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a272781-94f0-47d9-a8d8-3e2ed792060f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef1c9e9-f167-43f4-afcf-e19adfb339bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Volume 67c656d1-bc25-46bd-92e6-582fce049366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c656d1-bc25-46bd-92e6-582fce049366', 'volume_size': 1} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e 1073741824" returned: 0 in 0.668s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-23e8f084-d348-49ce-af72-93f288058e2b" acquired by "delete_snapshot" :: waited 0.113s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-d098ef48-059c-47ab-adbe-4af0778196fe" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-d098ef48-059c-47ab-adbe-4af0778196fe" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Deleting offline snapshot d098ef48-059c-47ab-adbe-4af0778196fe of volume 23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] snapshot_file for this snap is: volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf93310-3b2d-4c7a-8729-63f93ff8545f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Flow 'volume_create_manager' (05fbea5e-2e16-4b4e-a920-61a7ff8de535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21199d12-433e-4030-a06f-0603f88da8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (16a6a5be-b78a-49b1-9848-d91cae20a234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31647f05-cda2-4053-914f-b7ccb74d5ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31647f05-cda2-4053-914f-b7ccb74d5ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129505739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391e642b-bfdd-482f-a4ff-7728f4e778c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e Nov 02 18:06:30 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0663cd-4407-4852-b225-dddf3c26961d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0663cd-4407-4852-b225-dddf3c26961d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5818414-b225-4e73-abb9-40865849f8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5818414-b225-4e73-abb9-40865849f8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391e642b-bfdd-482f-a4ff-7728f4e778c8', 'volume_name': 'volume-391e642b-bfdd-482f-a4ff-7728f4e778c8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e577064-cd1b-459b-9195-b1228654fea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e577064-cd1b-459b-9195-b1228654fea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde2fc5d-9801-493e-b050-6b2f0172983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume 391e642b-bfdd-482f-a4ff-7728f4e778c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391e642b-bfdd-482f-a4ff-7728f4e778c8', 'volume_size': 1} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21199d12-433e-4030-a06f-0603f88da8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058356792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c28382-ea22-43e2-8111-cbba983a54a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7906c9ac0670466e94d3b5e55950929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='1d51519f926e408a9881e40fe15684d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243ac863-a781-4050-98e4-6b07ba1f3c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243ac863-a781-4050-98e4-6b07ba1f3c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4654dd3a-e5e4-47e7-b20c-6b1250131cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4654dd3a-e5e4-47e7-b20c-6b1250131cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28c28382-ea22-43e2-8111-cbba983a54a5', 'volume_name': 'volume-28c28382-ea22-43e2-8111-cbba983a54a5', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5731dd9b-5d75-4ce1-9739-f0c27deb2314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5731dd9b-5d75-4ce1-9739-f0c27deb2314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2105f7f2-77e4-4b57-b60a-bd87b8bda8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Volume 28c28382-ea22-43e2-8111-cbba983a54a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28c28382-ea22-43e2-8111-cbba983a54a5', 'volume_size': 1} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:30 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e" returned: 0 in 0.259s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.091s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1729400561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e96d976-1cca-43a9-ae64-db25756c524b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:28Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating volume 1e96d976-1cca-43a9-ae64-db25756c524b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:30 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (223e8b5c-c461-4ecb-b0b8-99aa025ae42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b 1073741824 Nov 02 18:06:30 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7fd4f4-0398-49ca-be70-ec009e4d16d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:30 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe" returned: 0 in 0.404s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23e8f084-d348-49ce-af72-93f288058e2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e (6d4f8560-e643-46cf-8aff-ab9f40a4160e): created successfully Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7fd4f4-0398-49ca-be70-ec009e4d16d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (059b4d46-2fad-41ff-9b39-570b82c2551e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[514d33d3-76be-4a93-aab7-7a6dddfd1426]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7466a97d-2c5d-40b9-9b76-25b0d43607ea tempest-CreateVolumesFromSnapshotTest-438153289 None] Created volume successfully. Nov 02 18:06:30 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b Nov 02 18:06:30 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:31 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b 1073741824" returned: 0 in 0.504s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:31 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b" returned: 0 in 0.436s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:31 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe Nov 02 18:06:31 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:31 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b Nov 02 18:06:31 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:31 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b" returned: 0 in 0.251s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-479806742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5edc189-9668-4e63-9caf-07b32d225a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:29Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating volume b5edc189-9668-4e63-9caf-07b32d225a10 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:31 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3925f7-1f6c-467e-9fe8-aa20c39c6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e96d976-1cca-43a9-ae64-db25756c524b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ac54f9-9191-4bd3-8e28-081f3c17684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:31 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 1073741824 Nov 02 18:06:31 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:31 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume volume-1e96d976-1cca-43a9-ae64-db25756c524b (1e96d976-1cca-43a9-ae64-db25756c524b): created successfully Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ac54f9-9191-4bd3-8e28-081f3c17684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:31 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (0ea7ac3a-6b5f-4498-930d-8bbc3eccbe2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe" returned: 0 in 0.345s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f62e4463-9860-410f-8f1c-89b27cc5900f tempest-CreateVolumesFromSnapshotTest-438153289 None] Created volume successfully. Nov 02 18:06:31 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe Nov 02 18:06:31 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:31 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b.d098ef48-059c-47ab-adbe-4af0778196fe" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-d098ef48-059c-47ab-adbe-4af0778196fe" released by "_delete_snapshot" :: held 1.565s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-23e8f084-d348-49ce-af72-93f288058e2b" released by "delete_snapshot" :: held 1.610s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Created reservations ['0e44eaf2-456c-48fa-aa2f-86cab2a7b0b6', 'dca01e9c-0472-4117-acbf-805ca6d3c990', '6a299699-c3be-4951-9697-0cd848569133', '629f5580-481e-411c-91fd-d09d583cb253'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:31 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 1073741824" returned: 0 in 0.469s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:31 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Delete snapshot completed successfully. Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-f9ff49c3-f531-4b1e-9fd3-e2c4276d56f9 tempest-ProjectReaderTests-910942523 None] Lock "cinder-d098ef48-059c-47ab-adbe-4af0778196fe-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:32 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 Nov 02 18:06:32 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:32 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1306811349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361bf32b-deb4-490e-9dd7-0b4e8862da8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating volume 361bf32b-deb4-490e-9dd7-0b4e8862da8a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:32 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-23e8f084-d348-49ce-af72-93f288058e2b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:32 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a 1073741824 Nov 02 18:06:32 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66de469d-f650-48d6-b369-05286f95fd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5edc189-9668-4e63-9caf-07b32d225a10', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b1ed1f-e941-4a37-a157-d361cad280d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Lock "cinder-23e8f084-d348-49ce-af72-93f288058e2b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:32 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume volume-b5edc189-9668-4e63-9caf-07b32d225a10 (b5edc189-9668-4e63-9caf-07b32d225a10): created successfully Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b1ed1f-e941-4a37-a157-d361cad280d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (782bfa16-d890-4131-b645-2d1bc7f40a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cf9ccaf2-dcea-4ae7-8bd2-ed357bf5bb88 tempest-CreateVolumesFromSnapshotTest-438153289 None] Created volume successfully. Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-23e8f084-d348-49ce-af72-93f288058e2b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-23e8f084-d348-49ce-af72-93f288058e2b" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e92338-8eaf-4674-82b5-1dceab01f533]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:32 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b Nov 02 18:06:32 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:32 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a 1073741824" returned: 0 in 0.422s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:32 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a Nov 02 18:06:32 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:32 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b" returned: 0 in 0.386s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:32 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b Nov 02 18:06:32 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:32 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.731s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c656d1-bc25-46bd-92e6-582fce049366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d711e379da4b4d9a887872af4381a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='63a371435e3843d282a87c12dc043790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Creating volume 67c656d1-bc25-46bd-92e6-582fce049366 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:32 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:32 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1839a7-5015-42a5-8f4a-f3b6bedb103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:32 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 1073741824 Nov 02 18:06:32 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8168680-d353-40ca-95df-2030f71554b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:33 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a (361bf32b-deb4-490e-9dd7-0b4e8862da8a): created successfully Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8168680-d353-40ca-95df-2030f71554b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (22b2534a-130a-4156-b8f5-bbd7ac3f9aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-673f62fe-08c7-4fbe-98e2-f824e01836ba tempest-CreateVolumesFromSnapshotTest-438153289 None] Created volume successfully. Nov 02 18:06:33 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-23e8f084-d348-49ce-af72-93f288058e2b" returned: 0 in 0.276s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-23e8f084-d348-49ce-af72-93f288058e2b" released by "delete_volume" :: held 0.720s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Created reservations ['24b7a5d3-439e-4a41-b7bb-4ec29f754077', '4300b41a-8501-4aaf-b61c-270fc1e69695', '8fce1d94-f4ae-4e6f-a195-5a38bbbba728', 'ce9028ef-2575-44a9-86ba-cf0009299a61'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:33 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:33 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:33 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 1073741824" returned: 0 in 0.521s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:33 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 Nov 02 18:06:33 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:33 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.307s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Deleted volume successfully. Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-baf384f2-171a-405d-9b24-e354e5e8db79 tempest-ProjectReaderTests-910942523 None] Lock "cinder-23e8f084-d348-49ce-af72-93f288058e2b-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:33 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366" returned: 0 in 0.251s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2129505739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391e642b-bfdd-482f-a4ff-7728f4e778c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986cd9d30db54fd481858e8527ce2ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='83f503ed88014a7aad5e31f2cc6d519a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Creating volume 391e642b-bfdd-482f-a4ff-7728f4e778c8 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:33 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef1c9e9-f167-43f4-afcf-e19adfb339bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c656d1-bc25-46bd-92e6-582fce049366', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:33 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 1073741824 Nov 02 18:06:33 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de30b403-13bc-4ec1-994e-14e4e4424a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:33 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Volume volume-67c656d1-bc25-46bd-92e6-582fce049366 (67c656d1-bc25-46bd-92e6-582fce049366): created successfully Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de30b403-13bc-4ec1-994e-14e4e4424a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Flow 'volume_create_manager' (00c04836-11fb-4639-b592-69904d2e12e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b3aa0e1b-5a1a-4fef-9eed-d28588f9814c tempest-CinderUnicodeTest-1728386860 None] Created volume successfully. Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (af3e4ca2-1257-410f-8988-69008db7150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05aca8a5-2516-4a20-b4f9-48e3aa62402c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05aca8a5-2516-4a20-b4f9-48e3aa62402c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995453825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ae9ff0-4860-4c24-bed5-9e5327944827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:34Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6e2fae-c7af-4807-80cc-ed17d8403c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6e2fae-c7af-4807-80cc-ed17d8403c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9448bc63-c6ae-4bff-b2cc-a60568c3618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9448bc63-c6ae-4bff-b2cc-a60568c3618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ae9ff0-4860-4c24-bed5-9e5327944827', 'volume_name': 'volume-87ae9ff0-4860-4c24-bed5-9e5327944827', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e3b7ab-0763-4848-8f40-b0c1dee753ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e3b7ab-0763-4848-8f40-b0c1dee753ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1ece77-3fda-46f7-a1d0-87737e2fa42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Volume 87ae9ff0-4860-4c24-bed5-9e5327944827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ae9ff0-4860-4c24-bed5-9e5327944827', 'volume_size': 1} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:34 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 1073741824" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:34 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 Nov 02 18:06:34 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:34 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8" returned: 0 in 0.257s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.024s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2058356792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28c28382-ea22-43e2-8111-cbba983a54a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7906c9ac0670466e94d3b5e55950929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:30Z,use_quota=True,user_id='1d51519f926e408a9881e40fe15684d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Creating volume 28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:34 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:34 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 1073741824 Nov 02 18:06:34 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde2fc5d-9801-493e-b050-6b2f0172983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391e642b-bfdd-482f-a4ff-7728f4e778c8', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05e7c5f-dfd5-4c8b-aa75-11fbdf37f61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:34 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Volume volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 (391e642b-bfdd-482f-a4ff-7728f4e778c8): created successfully Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05e7c5f-dfd5-4c8b-aa75-11fbdf37f61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Flow 'volume_create_manager' (16a6a5be-b78a-49b1-9848-d91cae20a234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-53d4b3fb-f620-454b-9d46-27058acb5d2e tempest-CreateVolumesFromSnapshotTest-438153289 None] Created volume successfully. Nov 02 18:06:34 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 1073741824" returned: 0 in 0.410s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:34 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 Nov 02 18:06:34 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:35 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5" returned: 0 in 0.249s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-995453825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ae9ff0-4860-4c24-bed5-9e5327944827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:34Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Creating volume 87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:35 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2105f7f2-77e4-4b57-b60a-bd87b8bda8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28c28382-ea22-43e2-8111-cbba983a54a5', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92b5888-0b75-48fb-b362-ece44e561a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:35 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 1073741824 Nov 02 18:06:35 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Volume volume-28c28382-ea22-43e2-8111-cbba983a54a5 (28c28382-ea22-43e2-8111-cbba983a54a5): created successfully Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92b5888-0b75-48fb-b362-ece44e561a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Flow 'volume_create_manager' (05fbea5e-2e16-4b4e-a920-61a7ff8de535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8e2d3de8-e2b6-4f18-b3c9-e6f0e8f7fdc3 tempest-VolumeDependencyTests-756710333 None] Created volume successfully. Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Flow 'volume_create_manager' (e40f1cba-35d5-417a-ab64-032cec021351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0543ae9c-1d7a-49b3-94e8-4691e829c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0543ae9c-1d7a-49b3-94e8-4691e829c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2064196963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5474a9b9-5596-43fb-ae26-0748beeec474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d711e379da4b4d9a887872af4381a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:36Z,use_quota=True,user_id='63a371435e3843d282a87c12dc043790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb539f42-f126-497a-9dd6-45929f80bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb539f42-f126-497a-9dd6-45929f80bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06274d1-cac4-41fa-8aa8-7fcc3e771a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06274d1-cac4-41fa-8aa8-7fcc3e771a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5474a9b9-5596-43fb-ae26-0748beeec474', 'volume_name': 'volume-5474a9b9-5596-43fb-ae26-0748beeec474', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9d51c8-b5bc-43f4-8704-149e177ef378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9d51c8-b5bc-43f4-8704-149e177ef378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a14e5b9-249b-4d0a-a1b5-9650038a342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Volume 5474a9b9-5596-43fb-ae26-0748beeec474: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5474a9b9-5596-43fb-ae26-0748beeec474', 'volume_size': 1} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-391e642b-bfdd-482f-a4ff-7728f4e778c8-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-391e642b-bfdd-482f-a4ff-7728f4e778c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-391e642b-bfdd-482f-a4ff-7728f4e778c8" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:35 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-391e642b-bfdd-482f-a4ff-7728f4e778c8" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 1073741824" returned: 0 in 0.533s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae122977-3b4b-4531-a107-8c79a46620d9]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:35 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 Nov 02 18:06:35 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:35 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 Nov 02 18:06:35 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:36 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827" returned: 0 in 0.252s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2064196963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5474a9b9-5596-43fb-ae26-0748beeec474,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11d711e379da4b4d9a887872af4381a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:36Z,use_quota=True,user_id='63a371435e3843d282a87c12dc043790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Creating volume 5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:36 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1ece77-3fda-46f7-a1d0-87737e2fa42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ae9ff0-4860-4c24-bed5-9e5327944827', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:36 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 1073741824 Nov 02 18:06:36 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0238a8-7b03-42bc-9586-64ee37193684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:36 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Volume volume-87ae9ff0-4860-4c24-bed5-9e5327944827 (87ae9ff0-4860-4c24-bed5-9e5327944827): created successfully Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0238a8-7b03-42bc-9586-64ee37193684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (af3e4ca2-1257-410f-8988-69008db7150b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dce498b7-1f37-44df-8b34-fea7a2089c27 tempest-ProjectReaderTests-910942523 None] Created volume successfully. Nov 02 18:06:36 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8" returned: 0 in 0.396s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:36 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8 Nov 02 18:06:36 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:36 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-391e642b-bfdd-482f-a4ff-7728f4e778c8" returned: 0 in 0.270s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-391e642b-bfdd-482f-a4ff-7728f4e778c8" released by "delete_volume" :: held 0.715s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['1e5ee61a-6d55-4c88-add4-1913f30c399b', '991bbc0e-ca55-4496-9f43-8f32c79467ff', '8be64c45-faa1-42f0-a89a-3bd441660893', 'ecae45fa-48f3-49f6-8a0f-208daad4644f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:36 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 1073741824" returned: 0 in 0.518s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:36 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:36 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:36 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 Nov 02 18:06:36 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-361bf32b-deb4-490e-9dd7-0b4e8862da8a-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-361bf32b-deb4-490e-9dd7-0b4e8862da8a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-361bf32b-deb4-490e-9dd7-0b4e8862da8a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-361bf32b-deb4-490e-9dd7-0b4e8862da8a" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:36 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.332s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:36 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474" returned: 0 in 0.290s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ac6cd4-d624-4027-a04f-a88cff6f51ed]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleted volume successfully. Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.250s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a14e5b9-249b-4d0a-a1b5-9650038a342a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5474a9b9-5596-43fb-ae26-0748beeec474', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0217bad6-fb05-4f5d-a7ff-299293594746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Creating offline snapshot fbdc16f5-a1ff-43a0-9035-162807216e23 of volume 28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c13dcd5f-41ab-420b-809f-8b345de067f0 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-391e642b-bfdd-482f-a4ff-7728f4e778c8-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:37 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Volume volume-5474a9b9-5596-43fb-ae26-0748beeec474 (5474a9b9-5596-43fb-ae26-0748beeec474): created successfully Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0217bad6-fb05-4f5d-a7ff-299293594746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Flow 'volume_create_manager' (e40f1cba-35d5-417a-ab64-032cec021351) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a97313-c662-4d05-8954-1f3280eef6b9]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-aad1205f-e7fc-46bc-bc28-4f34c059df32 tempest-CinderUnicodeTest-1728386860 None] Created volume successfully. Nov 02 18:06:37 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a Nov 02 18:06:37 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:37 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 Nov 02 18:06:37 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:37 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a" returned: 0 in 0.446s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:37 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a Nov 02 18:06:37 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:37 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5" returned: 0 in 0.430s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:37 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 1G Nov 02 18:06:37 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:37 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-361bf32b-deb4-490e-9dd7-0b4e8862da8a" returned: 0 in 0.281s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-361bf32b-deb4-490e-9dd7-0b4e8862da8a" released by "delete_volume" :: held 0.800s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['9bd107aa-7d49-4bfe-9e49-8e80f8c8ae48', '8f93243b-99eb-4b28-b18e-f66137888b85', '99b524f7-4626-4396-9a57-b40ef0701399', '19178614-eb56-424a-be09-e4c9ffc28c03'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:37 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:37 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:37 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 1G" returned: 0 in 0.511s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c28382-ea22-43e2-8111-cbba983a54a5 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:38 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c28382-ea22-43e2-8111-cbba983a54a5 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 Nov 02 18:06:38 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-b5edc189-9668-4e63-9caf-07b32d225a10-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-b5edc189-9668-4e63-9caf-07b32d225a10-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-b5edc189-9668-4e63-9caf-07b32d225a10" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-b5edc189-9668-4e63-9caf-07b32d225a10" acquired by "delete_volume" :: waited 0.032s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:38 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.308s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleted volume successfully. Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[677a33ec-f94e-47f9-90da-51f08408d57b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-44d244a5-37e6-40d1-99d9-c72ed6e98f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-361bf32b-deb4-490e-9dd7-0b4e8862da8a-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:38 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 Nov 02 18:06:38 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:38 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28c28382-ea22-43e2-8111-cbba983a54a5 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23" returned: 0 in 0.361s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:38 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 is being set with open permissions: ugo+rw Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:38 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 Nov 02 18:06:38 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:38 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10" returned: 0 in 0.398s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:38 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10 Nov 02 18:06:38 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:38 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23" returned: 0 in 0.266s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:38 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info Nov 02 18:06:38 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:38 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-b5edc189-9668-4e63-9caf-07b32d225a10" returned: 0 in 0.256s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-b5edc189-9668-4e63-9caf-07b32d225a10" released by "delete_volume" :: held 0.705s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['59d60cfa-dfd2-4384-9fe3-2f15668a930d', 'bdad7adb-af8b-4ad0-886d-f32c5ea12cc8', '0cdc2fe9-e031-4bb3-a100-da3eb24cee1f', 'ce3e8807-d565-49aa-aa74-250b3f3e9a23'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:38 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info" returned: 0 in 0.272s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:38 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info is being set with open permissions: ugo+rw Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:38 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info Nov 02 18:06:38 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:39 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:39 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:39 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.info" returned: 0 in 0.273s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.267s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.969s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Creating offline snapshot 69b68921-7cf2-41fb-9fb4-72588999c81f of volume 87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-718a9fc5-bcba-4fcc-b0d8-8af87d00d6c0 tempest-VolumeDependencyTests-756710333 None] Create snapshot completed successfully Nov 02 18:06:39 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-1e96d976-1cca-43a9-ae64-db25756c524b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac20e08f-1705-4544-b008-ff181ffc5557]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.339s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:39 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleted volume successfully. Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-1e96d976-1cca-43a9-ae64-db25756c524b-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-94df8b6e-d450-4f26-a95d-fe7336738f0d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-b5edc189-9668-4e63-9caf-07b32d225a10-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-1e96d976-1cca-43a9-ae64-db25756c524b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-1e96d976-1cca-43a9-ae64-db25756c524b" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dec2975-398e-4315-bc68-bdb3929eb746]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:39 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 Nov 02 18:06:39 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:39 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b Nov 02 18:06:39 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:39 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827" returned: 0 in 0.407s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:39 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f 1G Nov 02 18:06:39 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:39 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b" returned: 0 in 0.400s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:39 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b Nov 02 18:06:39 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:40 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-1e96d976-1cca-43a9-ae64-db25756c524b" returned: 0 in 0.276s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-1e96d976-1cca-43a9-ae64-db25756c524b" released by "delete_volume" :: held 0.723s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:40 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f 1G" returned: 0 in 0.475s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ae9ff0-4860-4c24-bed5-9e5327944827 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['50497191-c082-477b-83ff-3bfc974aeb6a', 'ee01bb90-6942-4303-96ce-ef08d9a5690f', '763b2ac4-4017-41f0-ab25-34286d49244a', '48b61e35-c3ee-4bde-823b-efc36b2fae57'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:40 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ae9ff0-4860-4c24-bed5-9e5327944827 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f Nov 02 18:06:40 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:40 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:40 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Flow 'volume_create_manager' (f23f5a01-d93d-4fe3-87fa-491a91059395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c572eda4-d4ea-47e8-8af9-ae42a8be13d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c572eda4-d4ea-47e8-8af9-ae42a8be13d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-65897597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d43e7115-caf7-4149-a276-712f038f19d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7906c9ac0670466e94d3b5e55950929c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fbdc16f5-a1ff-43a0-9035-162807216e23,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:40Z,use_quota=True,user_id='1d51519f926e408a9881e40fe15684d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084266a2-7e97-4e76-bf39-0752419699f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084266a2-7e97-4e76-bf39-0752419699f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f1fec6-f9be-4ab4-8fbc-53abcb3e0ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f1fec6-f9be-4ab4-8fbc-53abcb3e0ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd43e7115-caf7-4149-a276-712f038f19d5', 'volume_name': 'volume-d43e7115-caf7-4149-a276-712f038f19d5', 'volume_size': 1, 'snapshot_id': 'fbdc16f5-a1ff-43a0-9035-162807216e23'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1ea91e-b288-4381-b2be-ccc6c900e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1ea91e-b288-4381-b2be-ccc6c900e76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605278e6-2d63-463b-80e1-aa0dd6fbb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:40 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Volume d43e7115-caf7-4149-a276-712f038f19d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d43e7115-caf7-4149-a276-712f038f19d5', 'volume_size': 1, 'snapshot_id': 'fbdc16f5-a1ff-43a0-9035-162807216e23'} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-6d4f8560-e643-46cf-8aff-ab9f40a4160e-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:40 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87ae9ff0-4860-4c24-bed5-9e5327944827 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f" returned: 0 in 0.375s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:40 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f is being set with open permissions: ugo+rw Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-6d4f8560-e643-46cf-8aff-ab9f40a4160e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:40 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f Nov 02 18:06:40 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-6d4f8560-e643-46cf-8aff-ab9f40a4160e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-6d4f8560-e643-46cf-8aff-ab9f40a4160e" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:40 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.368s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c0558-c9fb-4d1a-8e38-5f5ac845b8a8]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleted volume successfully. Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74be563c-31ab-4dda-883e-ef9cba1d5a2d tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-1e96d976-1cca-43a9-ae64-db25756c524b-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:40 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e Nov 02 18:06:40 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:40 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f" returned: 0 in 0.275s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:40 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info Nov 02 18:06:40 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:41 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e" returned: 0 in 0.391s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:41 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e Nov 02 18:06:41 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:41 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:41 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info is being set with open permissions: ugo+rw Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:41 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info Nov 02 18:06:41 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:41 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d4f8560-e643-46cf-8aff-ab9f40a4160e" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-6d4f8560-e643-46cf-8aff-ab9f40a4160e" released by "delete_volume" :: held 0.718s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:41 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.info" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.468s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['5a4d31f1-dd1e-4c54-b55f-9da07467f6f8', '61ee361f-39ee-4d4d-aefd-27d2839c6624', '68656e8b-d504-4efa-af83-e787f84247df', '3469c813-eff2-4af1-a201-407e0a8c583c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Creating offline snapshot ab57f97c-77b1-4264-a306-e9586dc86767 of volume 5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d7e4d36b-c835-4ef1-9a55-f520d6fef716 tempest-ProjectReaderTests-910942523 None] Create snapshot completed successfully Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b70637-bee8-4ec5-950b-ac72fc613401]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:41 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:41 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:41 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 Nov 02 18:06:41 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-8141c346-f8e4-4d11-8594-a9ba9e19d86c-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-8141c346-f8e4-4d11-8594-a9ba9e19d86c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-172d1d6e-275c-4164-9b27-319e2ac93abf" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-172d1d6e-275c-4164-9b27-319e2ac93abf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-8141c346-f8e4-4d11-8594-a9ba9e19d86c" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-8141c346-f8e4-4d11-8594-a9ba9e19d86c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleting offline snapshot 8141c346-f8e4-4d11-8594-a9ba9e19d86c of volume 172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:41 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] snapshot_file for this snap is: volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleted volume successfully. Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd1c9f9-eaaa-478f-95a3-83b98fd280bc]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8cddf962-6e18-4298-a6e8-2cad1af56d22 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-6d4f8560-e643-46cf-8aff-ab9f40a4160e-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:41 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474" returned: 0 in 0.409s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:41 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 1G Nov 02 18:06:41 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:41 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c Nov 02 18:06:41 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:42 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-172d1d6e-275c-4164-9b27-319e2ac93abf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf59e8-73ba-41ed-9857-c8ea13c16c3b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:42 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 1G" returned: 0 in 0.406s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5474a9b9-5596-43fb-ae26-0748beeec474 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:42 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5474a9b9-5596-43fb-ae26-0748beeec474 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 Nov 02 18:06:42 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:42 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf Nov 02 18:06:42 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-69b68921-7cf2-41fb-9fb4-72588999c81f-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Lock "cinder-69b68921-7cf2-41fb-9fb4-72588999c81f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-87ae9ff0-4860-4c24-bed5-9e5327944827" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-87ae9ff0-4860-4c24-bed5-9e5327944827" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-69b68921-7cf2-41fb-9fb4-72588999c81f" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-69b68921-7cf2-41fb-9fb4-72588999c81f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Deleting offline snapshot 69b68921-7cf2-41fb-9fb4-72588999c81f of volume 87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] snapshot_file for this snap is: volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4368b6-cc14-40a2-90c8-cf1fe461bb61]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:42 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5474a9b9-5596-43fb-ae26-0748beeec474 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767" returned: 0 in 0.349s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:42 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 is being set with open permissions: ugo+rw Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:42 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf" returned: 0 in 0.412s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:42 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 Nov 02 18:06:42 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:42 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c Nov 02 18:06:42 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:42 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f Nov 02 18:06:42 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:42 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:42 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info Nov 02 18:06:42 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87ae9ff0-4860-4c24-bed5-9e5327944827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:43 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c" returned: 0 in 0.366s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037110e-bc15-492d-a4c4-3f351bb08312]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:43 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c Nov 02 18:06:43 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 Nov 02 18:06:43 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info" returned: 0 in 0.272s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info is being set with open permissions: ugo+rw Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:43 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info Nov 02 18:06:43 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf.8141c346-f8e4-4d11-8594-a9ba9e19d86c" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-8141c346-f8e4-4d11-8594-a9ba9e19d86c" released by "_delete_snapshot" :: held 1.530s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-172d1d6e-275c-4164-9b27-319e2ac93abf" released by "delete_snapshot" :: held 1.557s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['9e8bd660-5294-4c02-8893-77f876d5d104', '9f730293-bd49-47bc-8b8f-53664820b2fd', 'd2303963-7104-41b1-86a6-0612f2a62208', '8a8c2e27-6958-486e-8eaf-f1ebfe3fa5c5'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:43 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827" returned: 0 in 0.416s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Delete snapshot completed successfully. Nov 02 18:06:43 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3452271b-c3d5-4a0b-857a-0d7cf08c3906 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-8141c346-f8e4-4d11-8594-a9ba9e19d86c-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:43 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f Nov 02 18:06:43 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.info" returned: 0 in 0.291s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.949s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-quobyte-fbdc16f5-a1ff-43a0-9035-162807216e23-d43e7115-caf7-4149-a276-712f038f19d5" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-fbdc16f5-a1ff-43a0-9035-162807216e23-d43e7115-caf7-4149-a276-712f038f19d5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Creating volume d43e7115-caf7-4149-a276-712f038f19d5 from snapshot fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-quobyte-d43e7115-caf7-4149-a276-712f038f19d5" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:43 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a13adca1-595d-4193-9a94-819e1e0bcb29 tempest-CinderUnicodeTest-1728386860 None] Create snapshot completed successfully Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-d43e7115-caf7-4149-a276-712f038f19d5" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] snapshot: fbdc16f5-a1ff-43a0-9035-162807216e23, volume: d43e7115-caf7-4149-a276-712f038f19d5, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a50a598-abb0-4304-9ebf-9bf46cf89a73]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:43 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 Nov 02 18:06:43 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f" returned: 0 in 0.374s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:43 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f Nov 02 18:06:43 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-172d1d6e-275c-4164-9b27-319e2ac93abf-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-172d1d6e-275c-4164-9b27-319e2ac93abf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "cinder-quobyte-172d1d6e-275c-4164-9b27-319e2ac93abf" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-172d1d6e-275c-4164-9b27-319e2ac93abf" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8636d76-f41e-412b-94d3-8d9c95fbd2e4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23" returned: 0 in 0.410s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c28382-ea22-43e2-8111-cbba983a54a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f104cd03-fadd-4353-aa21-e609cca51597]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827.69b68921-7cf2-41fb-9fb4-72588999c81f" returned: 0 in 0.276s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-69b68921-7cf2-41fb-9fb4-72588999c81f" released by "_delete_snapshot" :: held 1.574s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-87ae9ff0-4860-4c24-bed5-9e5327944827" released by "delete_snapshot" :: held 1.600s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:44 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf Nov 02 18:06:44 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:44 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 Nov 02 18:06:44 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-ab57f97c-77b1-4264-a306-e9586dc86767-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Created reservations ['68b57c3e-754e-4d6c-90b5-b2384fa5ef19', 'bb1920e8-7c6b-4e88-b23e-2f44328fb315', 'd80bc8d1-e5dd-483c-a280-5b3b3bdc4cee', '71959d29-d542-4ccd-a4b9-d5212ebfcf4a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-ab57f97c-77b1-4264-a306-e9586dc86767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-quobyte-5474a9b9-5596-43fb-ae26-0748beeec474" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-5474a9b9-5596-43fb-ae26-0748beeec474" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-quobyte-ab57f97c-77b1-4264-a306-e9586dc86767" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-ab57f97c-77b1-4264-a306-e9586dc86767" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Deleting offline snapshot ab57f97c-77b1-4264-a306-e9586dc86767 of volume 5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] snapshot_file for this snap is: volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Delete snapshot completed successfully. Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece311b-5d62-45ac-bdab-62f8f54337bf]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-356c31e4-0aa1-411b-b291-19e78270deb6 tempest-ProjectReaderTests-910942523 None] Lock "cinder-69b68921-7cf2-41fb-9fb4-72588999c81f-delete_snapshot" released by "delete_snapshot" :: held 1.857s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:44 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf" returned: 0 in 0.418s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf Nov 02 18:06:44 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:44 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 Nov 02 18:06:44 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:44 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 Nov 02 18:06:44 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-87ae9ff0-4860-4c24-bed5-9e5327944827-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:44 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-172d1d6e-275c-4164-9b27-319e2ac93abf" returned: 0 in 0.274s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Lock "cinder-87ae9ff0-4860-4c24-bed5-9e5327944827-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-quobyte-172d1d6e-275c-4164-9b27-319e2ac93abf" released by "delete_volume" :: held 0.774s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-87ae9ff0-4860-4c24-bed5-9e5327944827" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:44 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767" returned: 0 in 0.440s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5474a9b9-5596-43fb-ae26-0748beeec474(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-87ae9ff0-4860-4c24-bed5-9e5327944827" acquired by "delete_volume" :: waited 0.041s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[36964581-ba8e-4d2e-8866-999899904635]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c795602-a256-40b7-ad9a-3ad46c035e2b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Created reservations ['bddd5e25-a015-4def-960d-94633d4e7432', 'cce51cb0-91c7-4341-8bbc-41dc17e1d9e2', '8a1bef42-7338-4d69-88a6-81ab71567f68', 'e4125e6a-b8e9-465c-b3be-fefd2f8fd5b3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:45 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 Nov 02 18:06:45 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:45 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 Nov 02 18:06:45 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:45 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:45 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:45 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827" returned: 0 in 0.688s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:45 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.588s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Deleted volume successfully. Nov 02 18:06:45 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827 Nov 02 18:06:45 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:45 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474" returned: 0 in 0.833s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-025b4bb2-bd30-4ca6-9ec6-4521edb7a040 tempest-CreateVolumesFromSnapshotTest-438153289 None] Lock "cinder-172d1d6e-275c-4164-9b27-319e2ac93abf-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:45 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 Nov 02 18:06:45 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:46 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-87ae9ff0-4860-4c24-bed5-9e5327944827" returned: 0 in 0.549s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-87ae9ff0-4860-4c24-bed5-9e5327944827" released by "delete_volume" :: held 1.335s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Created reservations ['8ed2707e-260e-44ac-b3a3-86ebf9609c9e', 'eb9323b5-960a-4817-b9c3-df899d12fae1', '00e70613-2108-4409-b98e-c9fd2b033a8e', 'cd8012b8-45d9-4543-a5c7-5421fa44adb4'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:46 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:46 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:46 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767" returned: 0 in 0.915s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:46 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:46 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:46 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767 Nov 02 18:06:46 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:46 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.428s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:46 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Deleted volume successfully. Nov 02 18:06:46 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7986877d-ef62-42e5-a664-5e692ae9d52f tempest-ProjectReaderTests-910942523 None] Lock "cinder-87ae9ff0-4860-4c24-bed5-9e5327944827-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:47 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474.ab57f97c-77b1-4264-a306-e9586dc86767" returned: 0 in 0.549s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:47 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.690s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-ab57f97c-77b1-4264-a306-e9586dc86767" released by "_delete_snapshot" :: held 2.970s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-5474a9b9-5596-43fb-ae26-0748beeec474" released by "delete_snapshot" :: held 3.029s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Created reservations ['e54ff416-248f-48f0-af6a-0d12068568d5', '547eac73-79af-45ef-8a7b-5d19ebd2e008', '4b83e684-fea5-42ba-9da8-a1719bce6b83', '9dfc3884-1b85-438c-b379-909e34c67f34'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Delete snapshot completed successfully. Nov 02 18:06:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4f2815eb-195b-490b-80c2-d29df95c0772 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-ab57f97c-77b1-4264-a306-e9586dc86767-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (15fba449-8ae1-40d6-a1cc-41d908d75884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08baf5cb-6537-4e8c-a82f-f0ff6687f17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08baf5cb-6537-4e8c-a82f-f0ff6687f17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673038767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f569df05-a03e-429f-b077-de7d433956fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:48Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01968a3c-78e4-41e7-847a-1002b918f9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01968a3c-78e4-41e7-847a-1002b918f9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6891f3-d661-4848-88e6-e1cdb4393c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6891f3-d661-4848-88e6-e1cdb4393c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f569df05-a03e-429f-b077-de7d433956fe', 'volume_name': 'volume-f569df05-a03e-429f-b077-de7d433956fe', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e142dee3-36be-4c17-bd8a-8191d789881e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e142dee3-36be-4c17-bd8a-8191d789881e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a572e65-86ea-44b4-b47a-007d737f5608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:48 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Volume f569df05-a03e-429f-b077-de7d433956fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f569df05-a03e-429f-b077-de7d433956fe', 'volume_size': 1} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-5474a9b9-5596-43fb-ae26-0748beeec474-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-5474a9b9-5596-43fb-ae26-0748beeec474-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-quobyte-5474a9b9-5596-43fb-ae26-0748beeec474" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-5474a9b9-5596-43fb-ae26-0748beeec474" acquired by "delete_volume" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf09659-2b2a-4716-8e05-f0c53177d500]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:49 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 Nov 02 18:06:49 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:49 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474" returned: 0 in 0.730s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:49 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474 Nov 02 18:06:49 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:50 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-5474a9b9-5596-43fb-ae26-0748beeec474" returned: 0 in 0.423s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-5474a9b9-5596-43fb-ae26-0748beeec474" released by "delete_volume" :: held 1.322s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Created reservations ['3ebff62a-703b-435b-9785-5c9f0540a699', 'a997b591-85e4-41e2-82ab-6676bf24b339', '5f29c1b1-dbc8-46da-b570-cc522119ffc6', 'c2701b08-99f7-4855-8aef-46d63cf21cea'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:50 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:50 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:50 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.407s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:50 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Deleted volume successfully. Nov 02 18:06:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-511c1f19-86e4-4532-ab7b-b43027e4665b tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-5474a9b9-5596-43fb-ae26-0748beeec474-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-67c656d1-bc25-46bd-92e6-582fce049366-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-67c656d1-bc25-46bd-92e6-582fce049366-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "cinder-quobyte-67c656d1-bc25-46bd-92e6-582fce049366" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-67c656d1-bc25-46bd-92e6-582fce049366" acquired by "delete_volume" :: waited 0.051s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:51 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[51390ed1-8ca8-45ee-b8cf-817c6f13e074]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:51 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 Nov 02 18:06:51 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:52 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366" returned: 0 in 0.757s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:52 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366 Nov 02 18:06:52 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:52 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-67c656d1-bc25-46bd-92e6-582fce049366" returned: 0 in 0.420s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-quobyte-67c656d1-bc25-46bd-92e6-582fce049366" released by "delete_volume" :: held 1.292s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Created reservations ['375fc834-9f79-4389-b172-e6bc483c3d24', '50011a81-1cdd-4f43-a555-1d3aaac12065', '0f4a703d-9970-4114-8598-d2e5a9c66265', 'bb0af2b9-f29f-47ab-a990-89b91e151160'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:52 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:52 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:53 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:53 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.440s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5" returned: 0 in 8.687s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5, size 1024.00 MB, duration 8.69 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:06:53 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Converted 1024.00 MB image at 117.85 MB/s Nov 02 18:06:53 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 is being set with open permissions: ugo+rw Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Deleted volume successfully. Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=282,cinder:SELECT=220,cinder:INSERT=73,cinder:DELETE=25 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:06:53 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 Nov 02 18:06:53 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9ef87e0a-e953-4b20-bdf0-e05b7ba7e388 tempest-CinderUnicodeTest-1728386860 None] Lock "cinder-67c656d1-bc25-46bd-92e6-582fce049366-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:53 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5" returned: 0 in 0.255s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-d43e7115-caf7-4149-a276-712f038f19d5" released by "_copy_volume_from_snapshot" :: held 9.926s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=211,cinder:UPDATE=309,cinder:DELETE=28,cinder:INSERT=79 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-fbdc16f5-a1ff-43a0-9035-162807216e23-d43e7115-caf7-4149-a276-712f038f19d5" released by "_create_volume_from_snapshot" :: held 10.013s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.036s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.139s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673038767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f569df05-a03e-429f-b077-de7d433956fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:48Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Creating volume f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:53 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:53 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe 1073741824 Nov 02 18:06:53 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605278e6-2d63-463b-80e1-aa0dd6fbb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d43e7115-caf7-4149-a276-712f038f19d5', 'volume_size': 1, 'snapshot_id': 'fbdc16f5-a1ff-43a0-9035-162807216e23'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dec797-a510-4981-9d7c-9414db972239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:53 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Volume volume-d43e7115-caf7-4149-a276-712f038f19d5 (d43e7115-caf7-4149-a276-712f038f19d5): created successfully Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dec797-a510-4981-9d7c-9414db972239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:53 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Flow 'volume_create_manager' (f23f5a01-d93d-4fe3-87fa-491a91059395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:53 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c3be23bb-af62-4ce3-b89b-4abbf9e48aac tempest-VolumeDependencyTests-756710333 None] Created volume successfully. Nov 02 18:06:54 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe 1073741824" returned: 0 in 0.530s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:54 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe Nov 02 18:06:54 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:54 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe" returned: 0 in 0.281s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a572e65-86ea-44b4-b47a-007d737f5608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f569df05-a03e-429f-b077-de7d433956fe', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719b4791-77f2-47aa-898d-0f56f0c8887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:54 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Volume volume-f569df05-a03e-429f-b077-de7d433956fe (f569df05-a03e-429f-b077-de7d433956fe): created successfully Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719b4791-77f2-47aa-898d-0f56f0c8887f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (15fba449-8ae1-40d6-a1cc-41d908d75884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:54 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3cb9b52b-87c5-4e13-a0fa-e53e3c5e1684 tempest-ProjectReaderTests-910942523 None] Created volume successfully. Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-fbdc16f5-a1ff-43a0-9035-162807216e23-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-fbdc16f5-a1ff-43a0-9035-162807216e23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-quobyte-28c28382-ea22-43e2-8111-cbba983a54a5" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Flow 'volume_create_manager' (454c8496-b9c4-4241-be84-4e9abef529db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cccaa9-8ce5-4ff2-a671-8f95775a147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-28c28382-ea22-43e2-8111-cbba983a54a5" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-quobyte-fbdc16f5-a1ff-43a0-9035-162807216e23" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70cccaa9-8ce5-4ff2-a671-8f95775a147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05faebd6-ac04-4828-93cc-efb7b39f88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1f580850da47fa891290f1f3771f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:55Z,use_quota=True,user_id='fbdb873578784635b70ea20b23171423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99b00a5-a836-4888-ab08-e65b3cfb5ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99b00a5-a836-4888-ab08-e65b3cfb5ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d65405-f08d-4dc6-86a9-da928d2029e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.image.glance [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Creating Keystone auth plugin from conf {{(pid=86585) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-fbdc16f5-a1ff-43a0-9035-162807216e23" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:54 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Deleting offline snapshot fbdc16f5-a1ff-43a0-9035-162807216e23 of volume 28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] snapshot_file for this snap is: volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2160c5-d0d7-444b-a56b-339f1159c1fa]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Creating offline snapshot 8f5a947a-5d04-4a34-a08c-4d9a46234dd7 of volume f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[41262b7d-bf02-4bf5-a9f8-c3679360fc42]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:55 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 Nov 02 18:06:55 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:55 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe Nov 02 18:06:55 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d65405-f08d-4dc6-86a9-da928d2029e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '05faebd6-ac04-4828-93cc-efb7b39f88a8', 'volume_name': 'volume-05faebd6-ac04-4828-93cc-efb7b39f88a8', 'volume_size': 1, 'image_id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24568065-14d7-41e2-a6b8-64319db67f7d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61a964afb632c8599250017b4b505c65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c1f580850da47fa891290f1f3771f9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '473c57da7cdab8afc54953c890bcc49356d8e727b93f16ab279602c4b1c606c7ff1ce9e014aaf353c75e96ecd50c7e7a97f560f75cca5f5e954d92fe1509c3c0', 'id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'created_at': datetime.datetime(2026, 11, 2, 17, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 6, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24568065-14d7-41e2-a6b8-64319db67f7d/file', 'properties': {}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c59d4d4-c1c2-4805-b0db-dfd5687de577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c59d4d4-c1c2-4805-b0db-dfd5687de577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d2ae3a-8a17-499e-b7e5-048bac3d7572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:55 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Volume 05faebd6-ac04-4828-93cc-efb7b39f88a8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-05faebd6-ac04-4828-93cc-efb7b39f88a8', 'volume_size': 1, 'image_id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24568065-14d7-41e2-a6b8-64319db67f7d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61a964afb632c8599250017b4b505c65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c1f580850da47fa891290f1f3771f9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '473c57da7cdab8afc54953c890bcc49356d8e727b93f16ab279602c4b1c606c7ff1ce9e014aaf353c75e96ecd50c7e7a97f560f75cca5f5e954d92fe1509c3c0', 'id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'created_at': datetime.datetime(2026, 11, 2, 17, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 6, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24568065-14d7-41e2-a6b8-64319db67f7d/file', 'properties': {}}, 'image_service': } Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Trying to clone 05faebd6-ac04-4828-93cc-efb7b39f88a8 from image 24568065-14d7-41e2-a6b8-64319db67f7d at location (None, [{'url': 'file:///opt/stack/data/glance/images/24568065-14d7-41e2-a6b8-64319db67f7d', 'metadata': {}}]). {{(pid=86585) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 18:06:55 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28c28382-ea22-43e2-8111-cbba983a54a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b055a-147f-4382-823b-7241de9d9cae]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 18:06:55 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Image download 0.00 MB at 0.00 MB/s Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5802ff-1b72-4866-8bb0-bf50c87f5a70]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:55 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe" returned: 0 in 0.452s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:55 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:55 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 1G Nov 02 18:06:55 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:55 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 Nov 02 18:06:55 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:55 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD Nov 02 18:06:55 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 1G" returned: 0 in 0.477s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f569df05-a03e-429f-b077-de7d433956fe -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f569df05-a03e-429f-b077-de7d433956fe -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 Nov 02 18:06:56 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD Nov 02 18:06:56 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5" returned: 0 in 0.668s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 Nov 02 18:06:56 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f569df05-a03e-429f-b077-de7d433956fe -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7" returned: 0 in 0.332s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 is being set with open permissions: ugo+rw Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Temporary image 24568065-14d7-41e2-a6b8-64319db67f7d is fetched for user fbdb873578784635b70ea20b23171423. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 18:06:56 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 Nov 02 18:06:56 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[075da8fa-829d-4b30-a9b4-dffcee6c55c6]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23" returned: 0 in 0.410s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23 Nov 02 18:06:56 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD Nov 02 18:06:56 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7" returned: 0 in 0.284s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:56 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info Nov 02 18:06:56 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:56 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5.fbdc16f5-a1ff-43a0-9035-162807216e23" returned: 0 in 0.317s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-fbdc16f5-a1ff-43a0-9035-162807216e23" released by "_delete_snapshot" :: held 2.028s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-28c28382-ea22-43e2-8111-cbba983a54a5" released by "delete_snapshot" :: held 2.087s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:57 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info" returned: 0 in 0.304s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:57 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info is being set with open permissions: ugo+rw Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:57 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info Nov 02 18:06:57 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Created reservations ['56d47e73-0e53-46f5-ac1a-7580dc9adfbc', 'efff1975-6942-461b-9efa-d8b2d94db6d7', '52a4b259-4a00-4178-ab27-b58f1577d0a3', '33d552ef-df56-4134-bbc8-393764007fba'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:57 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD Nov 02 18:06:57 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Delete snapshot completed successfully. Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3b4de8dd-6e78-4c2b-9f58-eb84aa857c92 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-fbdc16f5-a1ff-43a0-9035-162807216e23-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:57 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.info" returned: 0 in 0.292s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:57 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05faebd6-ac04-4828-93cc-efb7b39f88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c1f580850da47fa891290f1f3771f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:55Z,use_quota=True,user_id='fbdb873578784635b70ea20b23171423',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Creating volume 05faebd6-ac04-4828-93cc-efb7b39f88a8 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:57 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:57 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 1073741824 Nov 02 18:06:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3c294268-af92-473a-b325-c7e1656ed76e tempest-ProjectReaderTests-910942523 None] Create snapshot completed successfully Nov 02 18:06:57 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (69c82947-5e50-49fc-8063-acf8f6ae5ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c5e31b-ce5b-4ea3-8a07-be560dbd0982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c5e31b-ce5b-4ea3-8a07-be560dbd0982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846366948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c320a8f2-3acb-4f17-a797-4c7e5f5d35f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:58Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9673eee5-d757-451e-9886-e35b5ad495d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9673eee5-d757-451e-9886-e35b5ad495d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1bfd71-f903-42e0-80a4-970ee57e0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f1bfd71-f903-42e0-80a4-970ee57e0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c320a8f2-3acb-4f17-a797-4c7e5f5d35f2', 'volume_name': 'volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c39c1b-8a26-4f01-8d90-15b201f80aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c39c1b-8a26-4f01-8d90-15b201f80aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19aff0-9cad-4244-8f08-6d3b299602c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:57 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Volume c320a8f2-3acb-4f17-a797-4c7e5f5d35f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2', 'volume_size': 1} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:57 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 1073741824" returned: 0 in 0.432s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:57 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 Nov 02 18:06:57 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-28c28382-ea22-43e2-8111-cbba983a54a5-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-28c28382-ea22-43e2-8111-cbba983a54a5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-quobyte-28c28382-ea22-43e2-8111-cbba983a54a5" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-28c28382-ea22-43e2-8111-cbba983a54a5" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:58 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8" returned: 0 in 0.266s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.378s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846366948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c320a8f2-3acb-4f17-a797-4c7e5f5d35f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:06:58Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Creating volume c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:06:58 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50c6de-ae1f-4819-86b2-90245ce91e9a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 1073741824 Nov 02 18:06:58 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Attempting download of 24568065-14d7-41e2-a6b8-64319db67f7d ((None, [{'url': 'file:///opt/stack/data/glance/images/24568065-14d7-41e2-a6b8-64319db67f7d', 'metadata': {}}])) to volume 05faebd6-ac04-4828-93cc-efb7b39f88a8. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c6656c-f56c-40cd-ab4c-9e24212f6984]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-8f5a947a-5d04-4a34-a08c-4d9a46234dd7-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:58 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 Nov 02 18:06:58 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Lock "cinder-8f5a947a-5d04-4a34-a08c-4d9a46234dd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-f569df05-a03e-429f-b077-de7d433956fe" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-f569df05-a03e-429f-b077-de7d433956fe" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-8f5a947a-5d04-4a34-a08c-4d9a46234dd7" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-8f5a947a-5d04-4a34-a08c-4d9a46234dd7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Deleting offline snapshot 8f5a947a-5d04-4a34-a08c-4d9a46234dd7 of volume f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:06:58 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav Nov 02 18:06:58 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] snapshot_file for this snap is: volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2a906-4996-41a9-84eb-76ee2fa01c19]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 Nov 02 18:06:58 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5" returned: 0 in 0.528s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:58 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 1073741824" returned: 0 in 0.558s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav" returned: 0 in 0.449s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5 Nov 02 18:06:58 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 Nov 02 18:06:58 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav Nov 02 18:06:58 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:58 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7" returned: 0 in 0.429s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f569df05-a03e-429f-b077-de7d433956fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3661c09d-b7dd-4a32-ab95-5c5d8f6c5ebe]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:58 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-28c28382-ea22-43e2-8111-cbba983a54a5" returned: 0 in 0.275s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-28c28382-ea22-43e2-8111-cbba983a54a5" released by "delete_volume" :: held 0.902s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:59 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe Nov 02 18:06:59 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" returned: 0 in 0.305s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Created reservations ['1b704d2c-c0ea-4ee4-acb6-11df0ef1019d', '04f0276c-d159-41b7-8578-902be6f78540', 'c1a14f3b-7f77-4626-8602-b849a3ad0886', '6896cb82-41e8-442d-9666-55227ebb1505'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19aff0-9cad-4244-8f08-6d3b299602c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68f4d85-c83e-4d26-802e-52b4e678e0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:06:59 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav" returned: 1 in 0.389s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24568065-14d7-41e2-a6b8-64319db67f7d_mz83qlav' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[21655a88-8445-4508-b353-8b588b196d51]: (4, 'raw') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Volume volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 (c320a8f2-3acb-4f17-a797-4c7e5f5d35f2): created successfully Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d68f4d85-c83e-4d26-802e-52b4e678e0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (69c82947-5e50-49fc-8063-acf8f6ae5ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:06:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-48f8b8b1-a870-48ff-ab76-fffb2d616843 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD Nov 02 18:06:59 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-d43e7115-caf7-4149-a276-712f038f19d5-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:59 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:06:59 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Lock "cinder-d43e7115-caf7-4149-a276-712f038f19d5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Acquiring lock "cinder-quobyte-d43e7115-caf7-4149-a276-712f038f19d5" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-d43e7115-caf7-4149-a276-712f038f19d5" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:06:59 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe" returned: 0 in 0.482s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc335a4-b587-44d0-ae2f-2961b377fbf8]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 Nov 02 18:06:59 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.304s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:06:59 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 Nov 02 18:06:59 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Deleted volume successfully. Nov 02 18:06:59 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD" returned: 0 in 0.474s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-33adc32a-ccdf-4a85-9c80-0f50834ebbb7 tempest-VolumeDependencyTests-756710333 None] Lock "cinder-28c28382-ea22-43e2-8111-cbba983a54a5-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:06:59 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD Nov 02 18:06:59 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7" returned: 0 in 0.375s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7 Nov 02 18:06:59 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5" returned: 0 in 0.429s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:06:59 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5 Nov 02 18:06:59 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:06:59 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] 24568065-14d7-41e2-a6b8-64319db67f7d was raw, converting to qcow2 {{(pid=86585) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 18:06:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:00 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 Nov 02 18:07:00 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot d6d157ad-a5e9-4d31-81af-ad3a0478bd0f of volume c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5270e3-9100-45b3-84bc-b4e2d6915c1e]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:00 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:00 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-d43e7115-caf7-4149-a276-712f038f19d5" returned: 0 in 0.320s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe.8f5a947a-5d04-4a34-a08c-4d9a46234dd7" returned: 0 in 0.405s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Lock "cinder-quobyte-d43e7115-caf7-4149-a276-712f038f19d5" released by "delete_volume" :: held 0.847s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-8f5a947a-5d04-4a34-a08c-4d9a46234dd7" released by "_delete_snapshot" :: held 1.853s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-f569df05-a03e-429f-b077-de7d433956fe" released by "delete_snapshot" :: held 1.883s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:00 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 Nov 02 18:07:00 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Created reservations ['bb80a2ef-354a-4fd7-b756-222a50c4331f', '8815d0ab-b9c6-4d71-bc9b-1b2dddc472f2', '19f4e8f4-b64d-43ae-9433-7f5e91b29434', '71cf392c-f504-4205-9463-5f7712a3efd8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Created reservations ['7919f761-7253-4594-a12c-df1cd04b87f4', '86acc967-8b36-4a8a-8dbd-2fbce89aefee', '476be455-6048-4896-b73f-bb0ccb77ad91', 'b31a0e00-ee9b-4909-8a8d-5aedf092ea7e'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:00 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:00 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Delete snapshot completed successfully. Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9b00ad76-1f01-4fe3-8d9b-5a82460b97be tempest-ProjectReaderTests-910942523 None] Lock "cinder-8f5a947a-5d04-4a34-a08c-4d9a46234dd7-delete_snapshot" released by "delete_snapshot" :: held 2.182s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:00 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8" returned: 0 in 0.681s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24568065-14d7-41e2-a6b8-64319db67f7d_qei4db5jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:07:00 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:00 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" returned: 0 in 0.505s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:00 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 1G Nov 02 18:07:00 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:00 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f 1G Nov 02 18:07:00 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:00 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.275s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Deleted volume successfully. Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-8e913daa-689c-4ea9-8de7-3d8025d39e9f tempest-VolumeDependencyTests-756710333 None] Lock "cinder-d43e7115-caf7-4149-a276-712f038f19d5-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:00 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 1G" returned: 0 in 0.329s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Downloaded image 24568065-14d7-41e2-a6b8-64319db67f7d ((None, [{'url': 'file:///opt/stack/data/glance/images/24568065-14d7-41e2-a6b8-64319db67f7d', 'metadata': {}}])) to volume 05faebd6-ac04-4828-93cc-efb7b39f88a8 successfully. {{(pid=86585) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Temporary image 24568065-14d7-41e2-a6b8-64319db67f7d for user fbdb873578784635b70ea20b23171423 is deleted. {{(pid=86585) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 18:07:00 devstack cinder-volume[86585]: DEBUG cinder.volume.volume_utils [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Marking volume 05faebd6-ac04-4828-93cc-efb7b39f88a8 as bootable. {{(pid=86585) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Copying metadata from image 24568065-14d7-41e2-a6b8-64319db67f7d to 05faebd6-ac04-4828-93cc-efb7b39f88a8. {{(pid=86585) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Creating volume glance metadata for volume 05faebd6-ac04-4828-93cc-efb7b39f88a8 backed by image 24568065-14d7-41e2-a6b8-64319db67f7d with: {'image_id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '61a964afb632c8599250017b4b505c65', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86585) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d2ae3a-8a17-499e-b7e5-048bac3d7572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05faebd6-ac04-4828-93cc-efb7b39f88a8', 'volume_size': 1, 'image_id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24568065-14d7-41e2-a6b8-64319db67f7d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '61a964afb632c8599250017b4b505c65', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9c1f580850da47fa891290f1f3771f9a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '473c57da7cdab8afc54953c890bcc49356d8e727b93f16ab279602c4b1c606c7ff1ce9e014aaf353c75e96ecd50c7e7a97f560f75cca5f5e954d92fe1509c3c0', 'id': '24568065-14d7-41e2-a6b8-64319db67f7d', 'created_at': datetime.datetime(2026, 11, 2, 17, 6, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 17, 6, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24568065-14d7-41e2-a6b8-64319db67f7d/file', 'properties': {}}, 'image_service': }' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12be5d-3da5-4fa5-a92a-2da698699578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:01 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Volume volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 (05faebd6-ac04-4828-93cc-efb7b39f88a8): created successfully Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12be5d-3da5-4fa5-a92a-2da698699578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Flow 'volume_create_manager' (454c8496-b9c4-4241-be84-4e9abef529db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:01 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6e54e7c1-6d0f-4096-8c61-bc0265b23d1f tempest-VolumeImageDependencyTests-1546297295 None] Created volume successfully. Nov 02 18:07:01 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f 1G" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:01 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f Nov 02 18:07:01 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Acquiring lock "cinder-05faebd6-ac04-4828-93cc-efb7b39f88a8-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Lock "cinder-05faebd6-ac04-4828-93cc-efb7b39f88a8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Acquiring lock "cinder-quobyte-05faebd6-ac04-4828-93cc-efb7b39f88a8" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Lock "cinder-quobyte-05faebd6-ac04-4828-93cc-efb7b39f88a8" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e66535-6d18-4b31-80f8-5596e729d048]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:01 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" returned: 0 in 0.316s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:01 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f is being set with open permissions: ugo+rw Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:01 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f Nov 02 18:07:01 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:01 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 Nov 02 18:07:01 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-f569df05-a03e-429f-b077-de7d433956fe-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Lock "cinder-f569df05-a03e-429f-b077-de7d433956fe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-f569df05-a03e-429f-b077-de7d433956fe" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-f569df05-a03e-429f-b077-de7d433956fe" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b254d903-c625-4073-89e3-8f3957375bf1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:01 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" returned: 0 in 0.328s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:01 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info Nov 02 18:07:01 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:01 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:01 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8" returned: 0 in 0.471s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:01 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:01 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8 Nov 02 18:07:01 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:02 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info" returned: 0 in 0.292s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:02 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info is being set with open permissions: ugo+rw Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:02 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe" returned: 0 in 0.434s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:02 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:02 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:02 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05faebd6-ac04-4828-93cc-efb7b39f88a8" returned: 0 in 0.306s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:02 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe Nov 02 18:07:02 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Lock "cinder-quobyte-05faebd6-ac04-4828-93cc-efb7b39f88a8" released by "delete_volume" :: held 0.831s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Created reservations ['70d876bc-1d37-41f2-9752-3ed680f762bb', '8120d1f9-d7b1-4778-b429-edf1f3bf76ad', '341d58d5-9c6a-4c4d-add2-0b9240c5a4f4', '8ed0a634-683e-4ec2-8dbc-467b66ca38ca'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:02 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:02 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:02 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.info" returned: 0 in 0.342s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:02 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-f569df05-a03e-429f-b077-de7d433956fe" returned: 0 in 0.359s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-f569df05-a03e-429f-b077-de7d433956fe" released by "delete_volume" :: held 0.870s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-988604e6-57e1-4079-8876-033f68269fff tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Created reservations ['9bbd4097-0e5e-40c7-b19c-1c0d3877429e', 'e43411de-27e9-44bb-9151-65ea156e7571', '6c6b948b-6eab-4597-bb17-18b1af3546b7', '77e1683f-8e00-42e8-ae16-fe37c917584f'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:02 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.374s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:02 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:02 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Deleted volume successfully. Nov 02 18:07:02 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:02 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-ad153fde-d785-48ee-afdd-e193d5c4776f tempest-VolumeImageDependencyTests-1546297295 None] Lock "cinder-05faebd6-ac04-4828-93cc-efb7b39f88a8-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:03 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.282s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Deleted volume successfully. Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0d3556bc-5ed9-4484-a32e-ddd43738a08c tempest-ProjectReaderTests-910942523 None] Lock "cinder-f569df05-a03e-429f-b077-de7d433956fe-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-d6d157ad-a5e9-4d31-81af-ad3a0478bd0f-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-d6d157ad-a5e9-4d31-81af-ad3a0478bd0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot d6d157ad-a5e9-4d31-81af-ad3a0478bd0f of volume c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (2a998a92-7d4c-481f-b97b-3ad215554fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2350ea-efa7-44f8-856e-e36ad2f0e680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[559ee770-0de3-433f-95b3-6c9e2bdea4c0]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2350ea-efa7-44f8-856e-e36ad2f0e680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656156903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4d76b4-e553-48ef-933f-e5a65df4d8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:03Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5001a3-eeb0-4fcb-bc6b-66f549250ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5001a3-eeb0-4fcb-bc6b-66f549250ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ad17f-ed03-4f17-9e0c-7f9c1951cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28ad17f-ed03-4f17-9e0c-7f9c1951cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4d76b4-e553-48ef-933f-e5a65df4d8a0', 'volume_name': 'volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed82d8c3-7ce7-475d-84fe-66f96bac04e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed82d8c3-7ce7-475d-84fe-66f96bac04e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4837ff4e-24cc-4d5d-b244-4a71c4881c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:03 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Volume 2e4d76b4-e553-48ef-933f-e5a65df4d8a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0', 'volume_size': 1} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656156903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4d76b4-e553-48ef-933f-e5a65df4d8a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41ab75342c444754bdc621ce54a88a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:03Z,use_quota=True,user_id='4e55ad67391c4ccb90b89774902535e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Creating volume 2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:03 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:03 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f Nov 02 18:07:03 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:03 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 1073741824 Nov 02 18:07:03 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:03 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" returned: 0 in 0.491s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:03 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff2ecb9-56bf-4e4b-a3e1-51a9d64afd7d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:04 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 1073741824" returned: 0 in 0.539s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:04 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 Nov 02 18:07:04 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:04 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 Nov 02 18:07:04 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:04 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" returned: 0 in 0.340s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:04 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4837ff4e-24cc-4d5d-b244-4a71c4881c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bef82a5-3594-408a-9b0e-0690ddbebe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" returned: 0 in 0.536s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:04 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Volume volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 (2e4d76b4-e553-48ef-933f-e5a65df4d8a0): created successfully Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bef82a5-3594-408a-9b0e-0690ddbebe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:04 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f Nov 02 18:07:04 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Flow 'volume_create_manager' (2a998a92-7d4c-481f-b97b-3ad215554fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:04 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c7fea712-e68f-45be-ac91-985591c5696d tempest-ProjectReaderTests-910942523 None] Created volume successfully. Nov 02 18:07:04 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" returned: 0 in 0.379s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:04 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f Nov 02 18:07:04 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2.d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:05 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-d6d157ad-a5e9-4d31-81af-ad3a0478bd0f" released by "_delete_snapshot" :: held 1.837s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" released by "delete_snapshot" :: held 1.878s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Created reservations ['38399a69-c3ec-45e5-84a0-dfabda5c8ac9', '4e6a9db4-074b-4158-9aba-c5d7e6a061a5', 'fba95797-e727-4eee-96ed-7cfaa5f33d53', 'baefd6cd-117f-4e85-8b9a-2c7f63e26cb7'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:05 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-dca463de-abee-4c10-8173-4c03c90bfcd1 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-d6d157ad-a5e9-4d31-81af-ad3a0478bd0f-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Lock "cinder-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5f6924-8ea7-45f7-826d-6a1ecee2a90d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Creating offline snapshot e287634d-8257-4365-a9b6-cb9ccbfa7e91 of volume 2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[035a5499-16b7-46ff-b1c0-c2ec39a88929]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:05 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 Nov 02 18:07:05 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:05 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 Nov 02 18:07:05 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:06 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" returned: 0 in 0.431s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:06 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2 Nov 02 18:07:06 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:06 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:06 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 1G Nov 02 18:07:06 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:06 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" returned: 0 in 0.337s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2" released by "delete_volume" :: held 0.869s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Created reservations ['e1260cde-ffe3-4ea0-ade4-ed2e85a32e01', '3d08a884-d7a1-4200-9d78-d7d3eab38b77', 'e5be3905-b1db-4d40-b609-d2fe3dd308e1', '24cc0b70-71a2-4bb2-aae6-824287cc57d2'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:06 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:06 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-a13a35ed-3104-4c8c-95bb-16b299d4380c tempest-ProjectAdminTests-7784881 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7889251708984, 'free_capacity_gb': 1773.7889251708984, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86585) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 18:07:06 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 1G" returned: 0 in 0.564s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:06 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 Nov 02 18:07:06 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:07 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.390s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9cfa26ea-704f-4299-8ad0-8e33d562367a tempest-ProjectMemberTests-1879008254 None] Lock "cinder-c320a8f2-3acb-4f17-a797-4c7e5f5d35f2-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:07 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91" returned: 0 in 0.452s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:07 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 is being set with open permissions: ugo+rw Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:07 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 Nov 02 18:07:07 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (c4201d43-36f2-4375-9114-6b397228a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d0ecc1-e8a1-4834-b33f-b6a39ee34709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d0ecc1-e8a1-4834-b33f-b6a39ee34709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311281921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae7fa00-12f0-4da7-a6b0-b3daa04f654a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:07Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a0d593-1ee1-419a-87fc-a992d974f39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a0d593-1ee1-419a-87fc-a992d974f39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3506184-d6e2-401d-aed4-242f32d723bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3506184-d6e2-401d-aed4-242f32d723bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cae7fa00-12f0-4da7-a6b0-b3daa04f654a', 'volume_name': 'volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199ee3ef-38f2-4a4e-8b0e-7d6d944b31b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199ee3ef-38f2-4a4e-8b0e-7d6d944b31b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4b57f7-315d-4241-94a1-21f241b3f920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:07 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Volume cae7fa00-12f0-4da7-a6b0-b3daa04f654a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a', 'volume_size': 1} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:07 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91" returned: 0 in 0.309s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:07 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info Nov 02 18:07:07 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:07 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:07 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info is being set with open permissions: ugo+rw Nov 02 18:07:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:07 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info Nov 02 18:07:07 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:08 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.info" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.454s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-311281921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cae7fa00-12f0-4da7-a6b0-b3daa04f654a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:07Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Creating volume cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:08 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:08 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a 1073741824 Nov 02 18:07:08 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ca3632a7-59a3-4d33-8f0f-a614f1c63f7e tempest-ProjectReaderTests-910942523 None] Create snapshot completed successfully Nov 02 18:07:08 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a 1073741824" returned: 0 in 0.551s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:08 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a Nov 02 18:07:08 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:08 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-e287634d-8257-4365-a9b6-cb9ccbfa7e91-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Lock "cinder-e287634d-8257-4365-a9b6-cb9ccbfa7e91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-e287634d-8257-4365-a9b6-cb9ccbfa7e91" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-e287634d-8257-4365-a9b6-cb9ccbfa7e91" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Deleting offline snapshot e287634d-8257-4365-a9b6-cb9ccbfa7e91 of volume 2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] snapshot_file for this snap is: volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[01434cfb-5397-42ca-b38a-2eb249a2bdd3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:09 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" returned: 0 in 0.421s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:09 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:09 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4b57f7-315d-4241-94a1-21f241b3f920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993ab03c-a475-49d5-b1bd-e5d0314a1bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:09 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Volume volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a (cae7fa00-12f0-4da7-a6b0-b3daa04f654a): created successfully Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993ab03c-a475-49d5-b1bd-e5d0314a1bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (c4201d43-36f2-4375-9114-6b397228a98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:09 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4109cf1d-a37b-43a9-a5c2-6ca9cfdc8503 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:07:09 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91" returned: 0 in 0.517s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2916cda-1850-4a68-bc37-b1f9574b51fa]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot 783928ee-088f-4a1b-977d-8d25d806d803 of volume cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e47256b-b8c7-4e07-8965-65baeb20a635]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:09 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 Nov 02 18:07:09 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:09 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a Nov 02 18:07:09 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:10 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" returned: 0 in 0.437s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:10 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 Nov 02 18:07:10 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:10 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" returned: 0 in 0.485s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:10 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 1G Nov 02 18:07:10 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:10 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91" returned: 0 in 0.468s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:10 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91 Nov 02 18:07:10 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:10 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 1G" returned: 0 in 0.511s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:10 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 Nov 02 18:07:10 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:10 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0.e287634d-8257-4365-a9b6-cb9ccbfa7e91" returned: 0 in 0.302s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-e287634d-8257-4365-a9b6-cb9ccbfa7e91" released by "_delete_snapshot" :: held 1.911s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:10 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" released by "delete_snapshot" :: held 1.943s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Created reservations ['7c1cebb4-e281-4fab-a66a-d0a53a5e3d75', '6ad61ed0-90ec-47bb-be6b-b01db69b7cf0', 'd3ba21c8-fa2b-49a7-acb9-0e0bd886b2e2', '421a24ae-af63-4efe-a3d4-bfb21b262b49'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:11 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Delete snapshot completed successfully. Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-844555f5-940c-4f3d-97e1-e626812f0f5e tempest-ProjectReaderTests-910942523 None] Lock "cinder-e287634d-8257-4365-a9b6-cb9ccbfa7e91-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:11 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803" returned: 0 in 0.411s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:11 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 is being set with open permissions: ugo+rw Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:11 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 Nov 02 18:07:11 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-2e4d76b4-e553-48ef-933f-e5a65df4d8a0-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Lock "cinder-2e4d76b4-e553-48ef-933f-e5a65df4d8a0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Acquiring lock "cinder-quobyte-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" acquired by "delete_volume" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6cf936-c8d7-4cfd-9673-491c684127a5]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:11 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803" returned: 0 in 0.363s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:11 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 Nov 02 18:07:11 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:11 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info Nov 02 18:07:11 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:11 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info" returned: 0 in 0.289s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:11 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info is being set with open permissions: ugo+rw Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:11 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" returned: 0 in 0.467s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:11 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info Nov 02 18:07:11 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:11 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0 Nov 02 18:07:11 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:12 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.info" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:12 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" returned: 0 in 0.325s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Lock "cinder-quobyte-2e4d76b4-e553-48ef-933f-e5a65df4d8a0" released by "delete_volume" :: held 0.884s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e7bbd64d-2740-452b-a288-94b51b477501 tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Created reservations ['013afc8a-a7bf-436b-8b37-df8fb0a183ae', 'e0c137f8-855d-4487-a3bb-e97c9d86667f', '5efacd2f-e9a1-495d-9e92-84326802b333', '69ca252e-7255-4d6d-8f93-7e7a3dee71e8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:12 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:12 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:12 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.395s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Deleted volume successfully. Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-10df8ccd-3de8-4beb-ab7a-1976ea1f0561 tempest-ProjectReaderTests-910942523 None] Lock "cinder-2e4d76b4-e553-48ef-933f-e5a65df4d8a0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-783928ee-088f-4a1b-977d-8d25d806d803-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-783928ee-088f-4a1b-977d-8d25d806d803-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-783928ee-088f-4a1b-977d-8d25d806d803" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-783928ee-088f-4a1b-977d-8d25d806d803" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot 783928ee-088f-4a1b-977d-8d25d806d803 of volume cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[882d9e67-f218-4530-9d68-a4a73aac69f4]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:13 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 Nov 02 18:07:13 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:13 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803" returned: 0 in 0.484s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a4493-79f8-4b71-9217-90caf2d76af6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:13 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a Nov 02 18:07:13 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:14 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" returned: 0 in 0.526s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:14 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 Nov 02 18:07:14 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:14 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803" returned: 0 in 0.422s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:14 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803 Nov 02 18:07:14 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:14 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a.783928ee-088f-4a1b-977d-8d25d806d803" returned: 0 in 0.270s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-783928ee-088f-4a1b-977d-8d25d806d803" released by "_delete_snapshot" :: held 1.853s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" released by "delete_snapshot" :: held 1.888s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:14 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Created reservations ['66fc3f3f-1b17-47be-b732-f59af96281b8', '695ac72b-c691-442b-ad80-e47587d85411', '4690aecd-d43d-412b-9b7f-2eeb1d6f939f', '22a32d3b-6a57-4ae5-bb2b-cc37e3faf2c8'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:15 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9cdbce6-36b3-4852-8990-bde122b40983 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-783928ee-088f-4a1b-977d-8d25d806d803-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-cae7fa00-12f0-4da7-a6b0-b3daa04f654a-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Lock "cinder-cae7fa00-12f0-4da7-a6b0-b3daa04f654a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" acquired by "delete_volume" :: waited 0.029s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df2711-c5f9-4633-923d-d5fe2d7193b6]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:15 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a Nov 02 18:07:15 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:15 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" returned: 0 in 0.471s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:16 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a Nov 02 18:07:16 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:16 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" returned: 0 in 0.384s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-cae7fa00-12f0-4da7-a6b0-b3daa04f654a" released by "delete_volume" :: held 0.962s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Created reservations ['03f63ae2-48ec-4cf8-b08a-5f71d73f389f', '2233c249-ecdb-4f51-b773-c34a56287b87', '8df5e9f7-4891-4abc-a0fe-62a87ea8b2cf', '10fbc69e-c280-4aee-9f87-f5562319f0d2'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:16 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:16 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:16 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.259s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9bd33414-7074-4342-b4a7-30d52b8322bd tempest-ProjectMemberTests-1879008254 None] Lock "cinder-cae7fa00-12f0-4da7-a6b0-b3daa04f654a-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (81f132f7-e61d-47e9-a55c-6ced3f087840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9005b0-063d-4a62-a7a7-79b44f2c5c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9005b0-063d-4a62-a7a7-79b44f2c5c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089224101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8ee190-adce-4df7-9e77-61a2c8351e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:18Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3759c1d9-22f4-4a58-800b-9b186c34d813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3759c1d9-22f4-4a58-800b-9b186c34d813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93951e9c-693f-490d-bbb7-1aff27699942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93951e9c-693f-490d-bbb7-1aff27699942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d8ee190-adce-4df7-9e77-61a2c8351e08', 'volume_name': 'volume-7d8ee190-adce-4df7-9e77-61a2c8351e08', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197cc232-7e0b-4db2-a03d-8e0778a5b28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197cc232-7e0b-4db2-a03d-8e0778a5b28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f81882-a63b-405e-a9c2-df29748e2579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:18 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Volume 7d8ee190-adce-4df7-9e77-61a2c8351e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d8ee190-adce-4df7-9e77-61a2c8351e08', 'volume_size': 1} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089224101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d8ee190-adce-4df7-9e77-61a2c8351e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:18Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Creating volume 7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:18 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:18 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 1073741824 Nov 02 18:07:18 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:18 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 1073741824" returned: 0 in 0.611s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:19 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 Nov 02 18:07:19 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:19 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08" returned: 0 in 0.360s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f81882-a63b-405e-a9c2-df29748e2579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d8ee190-adce-4df7-9e77-61a2c8351e08', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0524b3c-5abe-43ff-a612-a18d25e88dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:19 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Volume volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 (7d8ee190-adce-4df7-9e77-61a2c8351e08): created successfully Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0524b3c-5abe-43ff-a612-a18d25e88dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:19 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (81f132f7-e61d-47e9-a55c-6ced3f087840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:19 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3cbd1905-3a89-4779-94bd-3ddd6a05bb6a tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:07:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:20 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot afae0e76-41b1-43c8-abba-16ef91416d75 of volume 7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:20 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eea798e-e45d-4ac0-aad1-42f10d8b5acc]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:20 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 Nov 02 18:07:20 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:21 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08" returned: 0 in 0.519s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:21 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 1G Nov 02 18:07:21 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:21 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 1G" returned: 0 in 0.525s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:21 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 Nov 02 18:07:21 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:21 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75" returned: 0 in 0.306s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:21 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 is being set with open permissions: ugo+rw Nov 02 18:07:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:21 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 Nov 02 18:07:21 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:22 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75" returned: 0 in 0.277s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:22 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info Nov 02 18:07:22 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:22 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info" returned: 0 in 0.378s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:22 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info is being set with open permissions: ugo+rw Nov 02 18:07:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:22 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info Nov 02 18:07:22 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:22 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.info" returned: 0 in 0.363s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-ebddfa92-7000-4fad-ab2a-01b65ed51343 tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-afae0e76-41b1-43c8-abba-16ef91416d75-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-afae0e76-41b1-43c8-abba-16ef91416d75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-7d8ee190-adce-4df7-9e77-61a2c8351e08" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-7d8ee190-adce-4df7-9e77-61a2c8351e08" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-afae0e76-41b1-43c8-abba-16ef91416d75" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-afae0e76-41b1-43c8-abba-16ef91416d75" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot afae0e76-41b1-43c8-abba-16ef91416d75 of volume 7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c81e2d6-6399-4ab7-9e09-28cfb033c173]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:24 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 Nov 02 18:07:24 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:24 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75" returned: 0 in 0.511s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d8ee190-adce-4df7-9e77-61a2c8351e08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:24 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c59062-24d5-444a-82c9-e2dfc309ab19]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:24 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 Nov 02 18:07:24 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:24 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08" returned: 0 in 0.512s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:25 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 Nov 02 18:07:25 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:25 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:25 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75 Nov 02 18:07:25 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:25 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08.afae0e76-41b1-43c8-abba-16ef91416d75" returned: 0 in 0.272s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-afae0e76-41b1-43c8-abba-16ef91416d75" released by "_delete_snapshot" :: held 1.935s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-7d8ee190-adce-4df7-9e77-61a2c8351e08" released by "delete_snapshot" :: held 1.965s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Created reservations ['760849ad-8a97-4f59-8efd-e6203b210ee2', '39dbebfb-33be-4585-9f18-4f6309def8ff', '7a54cb05-cf37-42f1-913e-0bc25b79248a', 'e58b46f6-277c-4acc-b46c-9edbc13bb29a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:25 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-74432d3b-020e-44c8-81cb-0109e2d266e9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-afae0e76-41b1-43c8-abba-16ef91416d75-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-7d8ee190-adce-4df7-9e77-61a2c8351e08-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-7d8ee190-adce-4df7-9e77-61a2c8351e08-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-7d8ee190-adce-4df7-9e77-61a2c8351e08" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-7d8ee190-adce-4df7-9e77-61a2c8351e08" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d8db46-4eae-40fb-bf01-e802a80e8e1f]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:26 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 Nov 02 18:07:26 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:26 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08" returned: 0 in 0.455s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:26 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08 Nov 02 18:07:26 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:26 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7d8ee190-adce-4df7-9e77-61a2c8351e08" returned: 0 in 0.326s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-7d8ee190-adce-4df7-9e77-61a2c8351e08" released by "delete_volume" :: held 0.875s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Created reservations ['41d7d822-7355-4427-9f71-2a2e6158902f', 'c8f2f484-3d47-4693-94be-f4843fe49b9d', '7e9e5fcf-17da-47bb-8051-803b97b82ba5', 'd48ac5be-7a6e-4458-915d-6fc9f0a32bf4'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:27 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:27 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:27 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.430s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:27 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-52773134-978e-4d82-b9ed-25b0210eca29 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-7d8ee190-adce-4df7-9e77-61a2c8351e08-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (1de9a7d4-a937-42f0-9ca2-aa2bbcd26a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052808e1-35e6-4a91-baa6-7c4857ef2595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052808e1-35e6-4a91-baa6-7c4857ef2595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741545895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6c7d0c-e180-49d6-a95b-ce12ee56676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:28Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd148d63-9a99-4828-a8e2-b967e36a6f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd148d63-9a99-4828-a8e2-b967e36a6f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb4d5ff-420f-41da-bd07-ca7d2689f181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb4d5ff-420f-41da-bd07-ca7d2689f181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6c7d0c-e180-49d6-a95b-ce12ee56676f', 'volume_name': 'volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52958039-a56a-4046-9396-46aea04dd4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52958039-a56a-4046-9396-46aea04dd4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4b0bce-1b5c-42fb-9ff4-73721716d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Volume 8e6c7d0c-e180-49d6-a95b-ce12ee56676f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f', 'volume_size': 1} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741545895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e6c7d0c-e180-49d6-a95b-ce12ee56676f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:28Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Creating volume 8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:28 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:28 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f 1073741824 Nov 02 18:07:28 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:28 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f 1073741824" returned: 0 in 0.546s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:28 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f Nov 02 18:07:28 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:29 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" returned: 0 in 0.360s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4b0bce-1b5c-42fb-9ff4-73721716d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f17edb-894b-4233-9590-3d9cad38cb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:29 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Volume volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f (8e6c7d0c-e180-49d6-a95b-ce12ee56676f): created successfully Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74f17edb-894b-4233-9590-3d9cad38cb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:29 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (1de9a7d4-a937-42f0-9ca2-aa2bbcd26a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:29 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b3c4809a-de61-4f4f-8cb4-3e7228502723 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot 1611dc2c-7b38-429e-9a61-77e62f764cef of volume 8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ac1ee-9f90-422d-abd1-a3f45412162a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:30 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f Nov 02 18:07:30 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (997945f7-10c0-451d-a29c-168b29a92a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f66554-7400-4006-b1f7-561b7c7c712c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f66554-7400-4006-b1f7-561b7c7c712c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753748916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec68b17d-dda5-417b-bf1c-f893f34ffaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:30Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b760916-717e-46d7-abff-d0de7240b9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b760916-717e-46d7-abff-d0de7240b9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0be498b-fa8f-40c7-95d6-16370f54c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0be498b-fa8f-40c7-95d6-16370f54c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec68b17d-dda5-417b-bf1c-f893f34ffaad', 'volume_name': 'volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6668d3a-f75c-40be-82d9-6b406d31341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6668d3a-f75c-40be-82d9-6b406d31341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9243d461-5b39-47ed-a41d-a398f16c7e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:30 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Volume ec68b17d-dda5-417b-bf1c-f893f34ffaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad', 'volume_size': 1} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:30 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" returned: 0 in 0.404s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:30 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef 1G Nov 02 18:07:30 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:31 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef 1G" returned: 0 in 0.390s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:31 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef Nov 02 18:07:31 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:31 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef" returned: 0 in 0.298s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:31 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef is being set with open permissions: ugo+rw Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:31 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef Nov 02 18:07:31 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:31 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:31 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info Nov 02 18:07:31 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:31 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:31 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info is being set with open permissions: ugo+rw Nov 02 18:07:31 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:32 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info Nov 02 18:07:32 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:32 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.info" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.606s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-753748916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec68b17d-dda5-417b-bf1c-f893f34ffaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:30Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Creating volume ec68b17d-dda5-417b-bf1c-f893f34ffaad {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:32 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:32 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad 1073741824 Nov 02 18:07:32 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:32 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-e743f195-b03d-47fa-b194-c4e5f50f628c tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-1611dc2c-7b38-429e-9a61-77e62f764cef-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-1611dc2c-7b38-429e-9a61-77e62f764cef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-1611dc2c-7b38-429e-9a61-77e62f764cef" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-1611dc2c-7b38-429e-9a61-77e62f764cef" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot 1611dc2c-7b38-429e-9a61-77e62f764cef of volume 8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacdd58e-6627-4ac0-8a00-c9d1c9503f80]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:32 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef Nov 02 18:07:32 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:32 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad 1073741824" returned: 0 in 0.477s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:32 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad Nov 02 18:07:32 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:32 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef" returned: 0 in 0.356s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a62127b-039f-4e5e-9b96-b8dddbc4e4af]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:32 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad" returned: 0 in 0.247s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:32 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9243d461-5b39-47ed-a41d-a398f16c7e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97032ff-b743-4c33-945d-b4a19d27a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:33 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Volume volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad (ec68b17d-dda5-417b-bf1c-f893f34ffaad): created successfully Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97032ff-b743-4c33-945d-b4a19d27a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (997945f7-10c0-451d-a29c-168b29a92a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:33 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-76227b2f-4878-43a3-8ed4-92579b88b7d8 tempest-ProjectReaderTests-413189133 None] Created volume successfully. Nov 02 18:07:33 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f Nov 02 18:07:33 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:33 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" returned: 0 in 0.355s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:33 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef Nov 02 18:07:33 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:33 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef" returned: 0 in 0.336s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:33 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef Nov 02 18:07:33 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:33 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f.1611dc2c-7b38-429e-9a61-77e62f764cef" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-1611dc2c-7b38-429e-9a61-77e62f764cef" released by "_delete_snapshot" :: held 1.400s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" released by "delete_snapshot" :: held 1.430s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:33 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Created reservations ['552e6b07-2a81-44d1-a9a2-5efd612eddba', '53dc88ef-ad83-45a3-98ee-112f0647ce7d', '344de0d8-b2aa-44ac-ae17-00fdcb23eba4', 'e6e7abb5-baa1-49dd-b9b9-bc566b848fd0'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-ec68b17d-dda5-417b-bf1c-f893f34ffaad-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Lock "cinder-ec68b17d-dda5-417b-bf1c-f893f34ffaad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-quobyte-ec68b17d-dda5-417b-bf1c-f893f34ffaad" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-ec68b17d-dda5-417b-bf1c-f893f34ffaad" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:34 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c9a30fb5-2ead-4d4b-abe2-c3c5f7962d71 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-1611dc2c-7b38-429e-9a61-77e62f764cef-delete_snapshot" released by "delete_snapshot" :: held 1.615s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5da2020-87ce-41e6-946e-fbb297ee0325]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:34 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad Nov 02 18:07:34 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:34 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad" returned: 0 in 0.350s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:34 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad Nov 02 18:07:34 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-8e6c7d0c-e180-49d6-a95b-ce12ee56676f-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Lock "cinder-8e6c7d0c-e180-49d6-a95b-ce12ee56676f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:34 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ec68b17d-dda5-417b-bf1c-f893f34ffaad" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-ec68b17d-dda5-417b-bf1c-f893f34ffaad" released by "delete_volume" :: held 0.649s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bb4f4a-ddb3-4ac4-8fd3-7cbd5c8866f3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Created reservations ['c900dabf-c1e1-4e04-a36d-979ff8202b43', '03bf391a-f2bd-4f9a-a5fc-a239793b0b23', 'cbd1c090-c2bf-4de1-9bf8-c3048dfb8133', 'f776f184-434a-40a8-ba60-f0a6c0ca5025'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:34 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:34 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f Nov 02 18:07:34 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:34 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:34 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:35 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Deleted volume successfully. Nov 02 18:07:35 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" returned: 0 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-b269801d-bc35-4dea-a34e-5c2a5ddb495b tempest-ProjectReaderTests-413189133 None] Lock "cinder-ec68b17d-dda5-417b-bf1c-f893f34ffaad-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:35 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f Nov 02 18:07:35 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:35 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" returned: 0 in 0.262s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-8e6c7d0c-e180-49d6-a95b-ce12ee56676f" released by "delete_volume" :: held 0.715s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Created reservations ['41be6efe-858d-439d-823a-69244f56f859', '42a49ed5-3bbc-4811-a2a2-a0614e369749', '455b7203-18ad-43ea-b98e-ebc9027b5994', 'a3d1dd6c-79e9-474c-91a1-28a50b18907c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:35 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:35 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (b3c5dcfa-ed48-4f1a-ab55-7ac6f4f6a1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88213db4-e863-4575-a8f8-f2319a5724dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88213db4-e863-4575-a8f8-f2319a5724dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865345018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af76cd77-c932-43bd-ab18-38321cbd10ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:36Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143fc01b-7806-474e-84c3-aff52418eb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (143fc01b-7806-474e-84c3-aff52418eb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671b4401-9eb1-4313-aabf-b39d8c721638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671b4401-9eb1-4313-aabf-b39d8c721638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af76cd77-c932-43bd-ab18-38321cbd10ff', 'volume_name': 'volume-af76cd77-c932-43bd-ab18-38321cbd10ff', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b801521c-60b3-4845-b608-e222c0ef280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b801521c-60b3-4845-b608-e222c0ef280d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7c8909-e071-4574-967f-b341a2c8faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:35 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Volume af76cd77-c932-43bd-ab18-38321cbd10ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af76cd77-c932-43bd-ab18-38321cbd10ff', 'volume_size': 1} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-865345018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af76cd77-c932-43bd-ab18-38321cbd10ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:36Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Creating volume af76cd77-c932-43bd-ab18-38321cbd10ff {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:35 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:35 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff 1073741824 Nov 02 18:07:35 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:35 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.263s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:35 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:35 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-890ac9bd-1157-47c7-b8dd-dd992eb3a92d tempest-ProjectMemberTests-1879008254 None] Lock "cinder-8e6c7d0c-e180-49d6-a95b-ce12ee56676f-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:36 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff 1073741824" returned: 0 in 0.480s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:36 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff Nov 02 18:07:36 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (82dad517-f638-4fd1-9878-5b8430f45c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e05d844-f37d-4ec0-9fbf-a8fd12aef5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e05d844-f37d-4ec0-9fbf-a8fd12aef5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850347883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36c65bb-6324-4a12-93a4-c21cfff94fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:36Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4fa7d1-7342-4397-bd89-50e7c27ba062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa4fa7d1-7342-4397-bd89-50e7c27ba062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a79522c-6005-45c7-bde4-258efc76802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a79522c-6005-45c7-bde4-258efc76802c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36c65bb-6324-4a12-93a4-c21cfff94fe4', 'volume_name': 'volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53877d38-551a-4c78-addb-6159058954e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53877d38-551a-4c78-addb-6159058954e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733c146c-9125-4688-badb-01213c1de834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:36 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Volume c36c65bb-6324-4a12-93a4-c21cfff94fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4', 'volume_size': 1} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:36 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-850347883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36c65bb-6324-4a12-93a4-c21cfff94fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:36Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Creating volume c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:36 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:36 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 1073741824 Nov 02 18:07:36 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d7c8909-e071-4574-967f-b341a2c8faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af76cd77-c932-43bd-ab18-38321cbd10ff', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3a624-ca00-41c4-b963-084607608244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:36 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Volume volume-af76cd77-c932-43bd-ab18-38321cbd10ff (af76cd77-c932-43bd-ab18-38321cbd10ff): created successfully Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb3a624-ca00-41c4-b963-084607608244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (b3c5dcfa-ed48-4f1a-ab55-7ac6f4f6a1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:36 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d9b1689a-a83b-4d27-a33a-b0f4f4277864 tempest-ProjectReaderTests-413189133 None] Created volume successfully. Nov 02 18:07:36 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 1073741824" returned: 0 in 0.408s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:36 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:36 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 Nov 02 18:07:36 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:37 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4" returned: 0 in 0.247s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (733c146c-9125-4688-badb-01213c1de834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd369a2a-4858-4656-9048-e9e304ac020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:37 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Volume volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 (c36c65bb-6324-4a12-93a4-c21cfff94fe4): created successfully Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd369a2a-4858-4656-9048-e9e304ac020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (82dad517-f638-4fd1-9878-5b8430f45c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:37 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-dbb79ea8-0151-46d7-b5e4-df7b707677f4 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-af76cd77-c932-43bd-ab18-38321cbd10ff-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Lock "cinder-af76cd77-c932-43bd-ab18-38321cbd10ff-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-quobyte-af76cd77-c932-43bd-ab18-38321cbd10ff" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-af76cd77-c932-43bd-ab18-38321cbd10ff" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e20987-faf3-4ee3-adce-a50c1f1b42d7]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:37 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:37 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff Nov 02 18:07:37 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:38 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff" returned: 0 in 0.355s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:38 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff Nov 02 18:07:38 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:38 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-af76cd77-c932-43bd-ab18-38321cbd10ff" returned: 0 in 0.257s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-af76cd77-c932-43bd-ab18-38321cbd10ff" released by "delete_volume" :: held 0.667s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot df3502ea-1c07-41b8-a715-08b4527b577e of volume c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[94008b31-607e-4c47-b901-197520afba99]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Created reservations ['f79b45ba-a1dc-48f0-a08f-55a4bdcd7df8', '76cb69ba-505c-4e6f-8d06-c498a71a09ed', 'e9c3aefa-b0a3-4af0-bca6-a4e0bfd2cbb2', 'bd7da021-fe16-4af4-9bfd-fab36fe7bd37'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:38 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:38 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:38 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 Nov 02 18:07:38 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:38 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.255s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:38 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Deleted volume successfully. Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3185523b-46ea-4739-84f3-7e94d0cb4435 tempest-ProjectReaderTests-413189133 None] Lock "cinder-af76cd77-c932-43bd-ab18-38321cbd10ff-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:38 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4" returned: 0 in 0.390s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:38 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:38 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e 1G Nov 02 18:07:38 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:39 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e 1G" returned: 0 in 0.437s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:39 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e Nov 02 18:07:39 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (5fb4363e-49cb-4866-b097-da1975db8647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5fabea-2f40-4eec-a159-f57f025c5ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d5fabea-2f40-4eec-a159-f57f025c5ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1070558207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebca7b48-af24-4f5b-b82a-5111d850b3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:39Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4c4d75-c018-472a-9b78-cdb2d6823b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4c4d75-c018-472a-9b78-cdb2d6823b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c41983b-eeb3-4ecc-9dc5-f5c85d2ecdad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c41983b-eeb3-4ecc-9dc5-f5c85d2ecdad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebca7b48-af24-4f5b-b82a-5111d850b3fe', 'volume_name': 'volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d88470-1b84-4876-82ae-6fbe76ef039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d88470-1b84-4876-82ae-6fbe76ef039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0050e158-80b2-4db0-a9b1-86badbb0d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:39 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Volume ebca7b48-af24-4f5b-b82a-5111d850b3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe', 'volume_size': 1} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:39 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e" returned: 0 in 0.301s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:39 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e is being set with open permissions: ugo+rw Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:39 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e Nov 02 18:07:39 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:39 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:39 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:39 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info Nov 02 18:07:39 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:40 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info" returned: 0 in 0.247s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:40 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info is being set with open permissions: ugo+rw Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:40 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info Nov 02 18:07:40 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:40 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.info" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1070558207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebca7b48-af24-4f5b-b82a-5111d850b3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:39Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Creating volume ebca7b48-af24-4f5b-b82a-5111d850b3fe {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:40 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:40 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe 1073741824 Nov 02 18:07:40 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:40 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-83257dd7-0e2c-432a-b482-6f227da33685 tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-df3502ea-1c07-41b8-a715-08b4527b577e-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-df3502ea-1c07-41b8-a715-08b4527b577e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-c36c65bb-6324-4a12-93a4-c21cfff94fe4" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c36c65bb-6324-4a12-93a4-c21cfff94fe4" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-df3502ea-1c07-41b8-a715-08b4527b577e" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-df3502ea-1c07-41b8-a715-08b4527b577e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot df3502ea-1c07-41b8-a715-08b4527b577e of volume c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e993754-8a12-4307-8c81-9e5b0d040536]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:40 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e Nov 02 18:07:40 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:40 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe 1073741824" returned: 0 in 0.432s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:40 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:40 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe Nov 02 18:07:40 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:41 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e" returned: 0 in 0.376s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9cc57b-3e84-4822-aa5c-37bbe755ff89]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:41 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0050e158-80b2-4db0-a9b1-86badbb0d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8cb3ef-6c25-4e7a-9013-cf503a6e986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:41 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Volume volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe (ebca7b48-af24-4f5b-b82a-5111d850b3fe): created successfully Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f8cb3ef-6c25-4e7a-9013-cf503a6e986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (5fb4363e-49cb-4866-b097-da1975db8647) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:41 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0ed1a1f2-c4bc-43bc-8d80-4dc94b12815c tempest-ProjectReaderTests-413189133 None] Created volume successfully. Nov 02 18:07:41 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 Nov 02 18:07:41 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-ebca7b48-af24-4f5b-b82a-5111d850b3fe-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Lock "cinder-ebca7b48-af24-4f5b-b82a-5111d850b3fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:41 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4" returned: 0 in 0.397s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-quobyte-ebca7b48-af24-4f5b-b82a-5111d850b3fe" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:41 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e Nov 02 18:07:41 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-ebca7b48-af24-4f5b-b82a-5111d850b3fe" acquired by "delete_volume" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb7956d-8a15-4fd5-8379-708eeed42a80]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:41 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe Nov 02 18:07:41 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:41 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e" returned: 0 in 0.333s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:41 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e Nov 02 18:07:41 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:41 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe" returned: 0 in 0.362s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:41 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:42 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe Nov 02 18:07:42 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:42 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4.df3502ea-1c07-41b8-a715-08b4527b577e" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-df3502ea-1c07-41b8-a715-08b4527b577e" released by "_delete_snapshot" :: held 1.443s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c36c65bb-6324-4a12-93a4-c21cfff94fe4" released by "delete_snapshot" :: held 1.473s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Created reservations ['c8086835-553f-450d-838f-8f0523efff10', '020a77fe-85eb-47c0-8be3-309abdd6f00d', '6159c070-5b1f-4a08-a528-5661f6644d43', '87755145-dd43-4945-9749-c7ab50e36308'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:42 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-ebca7b48-af24-4f5b-b82a-5111d850b3fe" returned: 0 in 0.270s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-ebca7b48-af24-4f5b-b82a-5111d850b3fe" released by "delete_volume" :: held 0.676s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:42 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-d67610c8-cab7-4f7e-ada3-6520b3cc4731 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-df3502ea-1c07-41b8-a715-08b4527b577e-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Created reservations ['83a3bd66-84dc-4db7-823e-21773fa7ce2b', '6403cc47-466c-41dd-92a9-8dc102f7d0f1', '71d8787b-f470-4680-9986-16fe43892755', 'b7c00bd2-da1e-41d6-8766-32e4b2dbf776'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:42 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:42 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:42 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.237s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:42 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Deleted volume successfully. Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-3e775953-393e-4548-88b0-6e392178376d tempest-ProjectReaderTests-413189133 None] Lock "cinder-ebca7b48-af24-4f5b-b82a-5111d850b3fe-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-c36c65bb-6324-4a12-93a4-c21cfff94fe4-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-c36c65bb-6324-4a12-93a4-c21cfff94fe4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-c36c65bb-6324-4a12-93a4-c21cfff94fe4" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c36c65bb-6324-4a12-93a4-c21cfff94fe4" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[949119dc-51d2-4735-8faa-27bd402d119c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:42 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:43 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 Nov 02 18:07:43 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (bd80662f-8f3a-4f4e-b982-790b61f25cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b31321-0a84-4728-9d3a-0147d7f74d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b31321-0a84-4728-9d3a-0147d7f74d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507919705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:43Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d702ab75-566e-4382-954c-794177fc5516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d702ab75-566e-4382-954c-794177fc5516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3750a7-2414-4749-8e69-509ffa79048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a3750a7-2414-4749-8e69-509ffa79048d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb', 'volume_name': 'volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e80c0b9-e741-499e-b3cf-8e0cbdc38f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e80c0b9-e741-499e-b3cf-8e0cbdc38f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59790bbb-c9d9-47c1-b417-9db1fd2d5f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:43 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Volume fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb', 'volume_size': 1} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507919705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4553e4736ddf4875a9709fed4b2b010c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:43Z,use_quota=True,user_id='d223518051d54de5ad9876c6010d3a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Creating volume fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:43 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:43 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb 1073741824 Nov 02 18:07:43 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:43 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4" returned: 0 in 0.401s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:43 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4 Nov 02 18:07:43 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:43 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-c36c65bb-6324-4a12-93a4-c21cfff94fe4" returned: 0 in 0.262s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-c36c65bb-6324-4a12-93a4-c21cfff94fe4" released by "delete_volume" :: held 0.745s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:43 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb 1073741824" returned: 0 in 0.471s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Created reservations ['7baf482a-7bb9-49e9-9994-7d053e23d8d0', '34bb4f38-02ba-40b5-8bfa-324cd6202952', '00c5d239-fb85-49ad-8bbc-b4cf14a0ac0d', '7de1d49c-035b-4107-a475-d2224422944a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:43 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb Nov 02 18:07:43 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:43 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:43 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:43 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb" returned: 0 in 0.245s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59790bbb-c9d9-47c1-b417-9db1fd2d5f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839da547-c902-4e0b-901b-5f051b990ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:43 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Volume volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb (fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb): created successfully Nov 02 18:07:43 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839da547-c902-4e0b-901b-5f051b990ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Flow 'volume_create_manager' (bd80662f-8f3a-4f4e-b982-790b61f25cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6d205f72-e2f5-480c-b6c6-55ceec24a6e1 tempest-ProjectReaderTests-413189133 None] Created volume successfully. Nov 02 18:07:44 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.277s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:44 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-9c539b53-11e1-4752-96f1-15fdf3045515 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-c36c65bb-6324-4a12-93a4-c21cfff94fe4-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Lock "cinder-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Acquiring lock "cinder-quobyte-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb81510-316a-4c97-b058-4621843e0c38]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:44 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb Nov 02 18:07:44 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (54c2204b-e56c-4926-844c-ad43bfa4843f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd043824-5edf-4533-97f7-e670c46aa33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd043824-5edf-4533-97f7-e670c46aa33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309109766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d13866f-d5f8-41c6-bf4f-6259f6ff2f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:44Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5f42f0-9a4e-4241-a49b-0131edf3bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5f42f0-9a4e-4241-a49b-0131edf3bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbefb65-561f-4513-9863-616ceb92dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbefb65-561f-4513-9863-616ceb92dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d13866f-d5f8-41c6-bf4f-6259f6ff2f42', 'volume_name': 'volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa56e23-0f8b-45dd-95fb-e56bdbc44435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa56e23-0f8b-45dd-95fb-e56bdbc44435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29a25a6-88c5-4966-9f14-7a94f7ef49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:44 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Volume 6d13866f-d5f8-41c6-bf4f-6259f6ff2f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42', 'volume_size': 1} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309109766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d13866f-d5f8-41c6-bf4f-6259f6ff2f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:44Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Creating volume 6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:44 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:44 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 1073741824 Nov 02 18:07:44 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:44 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb" returned: 0 in 0.378s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:44 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb Nov 02 18:07:44 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:44 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb" returned: 0 in 0.255s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Lock "cinder-quobyte-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb" released by "delete_volume" :: held 0.675s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:44 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Created reservations ['235c1e85-8cad-47e7-91eb-d320d3ff95d4', '066b50c4-96cc-4e5a-a1c4-cfcebc8543ab', '554f3563-c291-42ad-9ca4-bcea511e12fb', '1ed9352e-bf1f-4f9a-ba24-6819a757b272'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:44 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 1073741824" returned: 0 in 0.427s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:45 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 Nov 02 18:07:45 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:45 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:45 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:45 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" returned: 0 in 0.245s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29a25a6-88c5-4966-9f14-7a94f7ef49b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473686d8-18e7-4e5e-abd1-13e7f0aa7413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:45 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Volume volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 (6d13866f-d5f8-41c6-bf4f-6259f6ff2f42): created successfully Nov 02 18:07:45 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473686d8-18e7-4e5e-abd1-13e7f0aa7413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (54c2204b-e56c-4926-844c-ad43bfa4843f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Deleted volume successfully. Nov 02 18:07:45 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2c0c0d1f-f3d7-4d25-8278-ae2972838c77 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-251c151a-5791-4eb7-85cd-5e00a9b96be0 tempest-ProjectReaderTests-413189133 None] Lock "cinder-fe7c0f9f-fa1e-4fd9-b8d9-06ab634539cb-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 of volume 6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f998bf2-ca58-48bb-be52-8d3e45e96243]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:45 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:45 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 Nov 02 18:07:45 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:46 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" returned: 0 in 0.369s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:46 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 1G Nov 02 18:07:46 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:46 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 1G" returned: 0 in 0.433s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:46 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 Nov 02 18:07:46 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:46 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:46 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:46 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" returned: 0 in 0.321s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:46 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 is being set with open permissions: ugo+rw Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:46 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 Nov 02 18:07:46 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:46 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.299s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:07:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 18:07:47 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" returned: 0 in 0.256s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:47 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info Nov 02 18:07:47 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:47 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info" returned: 0 in 0.262s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:47 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info is being set with open permissions: ugo+rw Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:47 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info Nov 02 18:07:47 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:47 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.info" returned: 0 in 0.245s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:47 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a62e2f0a-04be-4998-856a-cda7737dc009 tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-e6bf8d4b-6a68-4f79-99ce-48b6faecaea3-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-e6bf8d4b-6a68-4f79-99ce-48b6faecaea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 of volume 6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[204aeb0a-93ab-4f39-bec4-323bfbc4db72]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:47 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:48 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 Nov 02 18:07:48 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:48 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" returned: 0 in 0.380s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:48 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:48 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[941a0d60-84ee-4a07-8c86-60a66d7292ec]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:48 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 Nov 02 18:07:48 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:48 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" returned: 0 in 0.411s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:48 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:48 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 Nov 02 18:07:48 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:49 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:49 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3 Nov 02 18:07:49 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:49 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42.e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-e6bf8d4b-6a68-4f79-99ce-48b6faecaea3" released by "_delete_snapshot" :: held 1.616s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" released by "delete_snapshot" :: held 1.644s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Created reservations ['021e0545-d1c6-44c7-b6a1-44a3dca21a0e', '1ace8364-f1e8-44eb-97c4-f841978c0244', 'f0520f6b-e8c0-49c4-9ccc-e42667a1a88b', '38ab1743-dcb0-47c4-b7b9-ec6c0a0473aa'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:49 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4a235c02-8e11-4478-b86d-1fc2beb1a023 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-e6bf8d4b-6a68-4f79-99ce-48b6faecaea3-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:49 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" acquired by "delete_volume" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1123ca-dc3f-4abc-87eb-3cee71b8cf37]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:50 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 Nov 02 18:07:50 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:50 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" returned: 0 in 0.367s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:50 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42 Nov 02 18:07:50 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:50 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" returned: 0 in 0.267s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42" released by "delete_volume" :: held 0.698s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Created reservations ['8ddb9feb-0760-4d0d-bb32-65c3b13302f5', '70694338-303d-4f89-af95-2c765c611e1a', '9f8c7f19-5194-47a1-a765-16c76106a955', 'd7c21887-231d-4417-9458-4d7d87eabbb7'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:50 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:50 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:50 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:51 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.277s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:51 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-41061959-7ec4-490e-9703-56ea442251a9 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-6d13866f-d5f8-41c6-bf4f-6259f6ff2f42-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (11626a06-fb72-48af-96f5-92a753c51e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13884f1d-a307-4279-ad3f-61b04302a363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13884f1d-a307-4279-ad3f-61b04302a363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127736296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b29250-9d5b-4583-93cb-e745ff02ed6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:52Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3649236-f469-4a46-af08-d5084762c351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3649236-f469-4a46-af08-d5084762c351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d7f716-0688-48de-a8d0-cf76d3875cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6d7f716-0688-48de-a8d0-cf76d3875cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b29250-9d5b-4583-93cb-e745ff02ed6e', 'volume_name': 'volume-05b29250-9d5b-4583-93cb-e745ff02ed6e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c14f54-a5ce-4bde-8448-22505b63f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c14f54-a5ce-4bde-8448-22505b63f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4623a8-99d3-414e-bd94-3b452bb1d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:51 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Volume 05b29250-9d5b-4583-93cb-e745ff02ed6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b29250-9d5b-4583-93cb-e745ff02ed6e', 'volume_size': 1} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:07:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1127736296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b29250-9d5b-4583-93cb-e745ff02ed6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:07:52Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Creating volume 05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:51 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:51 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:51 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e 1073741824 Nov 02 18:07:51 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:52 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e 1073741824" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:52 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e Nov 02 18:07:52 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:52 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e" returned: 0 in 0.246s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4623a8-99d3-414e-bd94-3b452bb1d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b29250-9d5b-4583-93cb-e745ff02ed6e', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74192baf-840f-4998-9192-5e98953d986b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:52 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Volume volume-05b29250-9d5b-4583-93cb-e745ff02ed6e (05b29250-9d5b-4583-93cb-e745ff02ed6e): created successfully Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74192baf-840f-4998-9192-5e98953d986b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (11626a06-fb72-48af-96f5-92a753c51e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:52 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-6fa82968-c6f4-4f37-833b-5e96d4fd1af6 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot 862f95bc-527a-4bc4-9fe8-b0ddfff04c1a of volume 05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127fe06-6f38-4896-8c71-559921dae07d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:52 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:52 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e Nov 02 18:07:52 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:53 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e" returned: 0 in 0.441s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:53 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a 1G Nov 02 18:07:53 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:53 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a 1G" returned: 0 in 0.442s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:53 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b29250-9d5b-4583-93cb-e745ff02ed6e -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:53 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b29250-9d5b-4583-93cb-e745ff02ed6e -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a Nov 02 18:07:53 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:54 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b29250-9d5b-4583-93cb-e745ff02ed6e -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" returned: 0 in 0.324s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:54 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a is being set with open permissions: ugo+rw Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:54 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a Nov 02 18:07:54 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:54 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=227,cinder:SELECT=181,cinder:INSERT=57,cinder:DELETE=22 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:UPDATE=229,cinder:DELETE=16,cinder:INSERT=71,cinder:SELECT=168 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:54 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info Nov 02 18:07:54 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:54 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info" returned: 0 in 0.273s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:54 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info is being set with open permissions: ugo+rw Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:54 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info Nov 02 18:07:54 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:54 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.info" returned: 0 in 0.303s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:54 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:54 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-be0c4eb8-7ce4-433c-8f8a-feff115ce5f6 tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-862f95bc-527a-4bc4-9fe8-b0ddfff04c1a-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-862f95bc-527a-4bc4-9fe8-b0ddfff04c1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-05b29250-9d5b-4583-93cb-e745ff02ed6e" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-05b29250-9d5b-4583-93cb-e745ff02ed6e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot 862f95bc-527a-4bc4-9fe8-b0ddfff04c1a of volume 05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[48674c6c-af32-48e5-a0ab-56e2ef883be3]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:56 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a Nov 02 18:07:56 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:56 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" returned: 0 in 0.464s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b29250-9d5b-4583-93cb-e745ff02ed6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24f67d-6ae9-47ba-bb55-ce36d97318c1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:56 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:56 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e Nov 02 18:07:56 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:57 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:57 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a Nov 02 18:07:57 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:57 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" returned: 0 in 0.405s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:57 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a Nov 02 18:07:57 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:57 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e.862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-862f95bc-527a-4bc4-9fe8-b0ddfff04c1a" released by "_delete_snapshot" :: held 1.683s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-05b29250-9d5b-4583-93cb-e745ff02ed6e" released by "delete_snapshot" :: held 1.709s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Created reservations ['47013648-067b-4345-be58-caf3f5e1402f', '41ce45d1-8129-483f-8d34-3140d74ae032', '3302dbf4-ab30-445a-b680-954ac1635058', '8e143a58-5578-4b84-b10d-0a1343938bc9'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:57 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:07:57 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-347decb8-c3ce-48ed-a55d-ec7505e8a4a3 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-862f95bc-527a-4bc4-9fe8-b0ddfff04c1a-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-05b29250-9d5b-4583-93cb-e745ff02ed6e-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-05b29250-9d5b-4583-93cb-e745ff02ed6e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-05b29250-9d5b-4583-93cb-e745ff02ed6e" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-05b29250-9d5b-4583-93cb-e745ff02ed6e" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27f279-becf-401e-bea6-3eac5031e61a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:58 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e Nov 02 18:07:58 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:58 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e" returned: 0 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:58 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e Nov 02 18:07:58 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:58 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:58 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-05b29250-9d5b-4583-93cb-e745ff02ed6e" returned: 0 in 0.248s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-05b29250-9d5b-4583-93cb-e745ff02ed6e" released by "delete_volume" :: held 0.701s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Created reservations ['8149c74f-3372-46f9-b076-c4962f43d217', '1826a59e-ae15-486d-b5f3-c4bbc443806d', '022dcf55-3578-44c2-a63d-bc864e0d5ddb', 'c12bdefd-6053-468f-bc69-83ec9b3dd792'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:59 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:07:59 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:07:59 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.275s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:07:59 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-4b480c3a-c991-47fd-8f42-10bdaf27e3b8 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-05b29250-9d5b-4583-93cb-e745ff02ed6e-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (fb54b394-b4fc-4ee8-86d8-75c4c4fcef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0063f649-3b7a-49b2-aff2-518fde8a3128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0063f649-3b7a-49b2-aff2-518fde8a3128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463532060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81118b88-7496-487c-97eb-fea58039a3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:00Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c5978-d9a3-48a1-bb3d-d3adf07afef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338c5978-d9a3-48a1-bb3d-d3adf07afef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a2115a-4ebd-4eea-b465-c5533e2b3d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a2115a-4ebd-4eea-b465-c5533e2b3d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81118b88-7496-487c-97eb-fea58039a3b1', 'volume_name': 'volume-81118b88-7496-487c-97eb-fea58039a3b1', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a88d46b-1476-4abd-baee-dbf204abebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a88d46b-1476-4abd-baee-dbf204abebd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789b7690-3fde-48ac-ada6-dfad72a76d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:07:59 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Volume 81118b88-7496-487c-97eb-fea58039a3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81118b88-7496-487c-97eb-fea58039a3b1', 'volume_size': 1} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-463532060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81118b88-7496-487c-97eb-fea58039a3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:00Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Creating volume 81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:07:59 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:07:59 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:07:59 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 1073741824 Nov 02 18:07:59 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:00 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 1073741824" returned: 0 in 0.443s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:00 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 Nov 02 18:08:00 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:00 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1" returned: 0 in 0.254s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789b7690-3fde-48ac-ada6-dfad72a76d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81118b88-7496-487c-97eb-fea58039a3b1', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e876755-f4ec-4323-adef-e0dcf0f1e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:00 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Volume volume-81118b88-7496-487c-97eb-fea58039a3b1 (81118b88-7496-487c-97eb-fea58039a3b1): created successfully Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e876755-f4ec-4323-adef-e0dcf0f1e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:00 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (fb54b394-b4fc-4ee8-86d8-75c4c4fcef5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:00 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-09ea2d38-3bfa-4a41-844d-a07456a71b1c tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot 9c3220e8-8e63-424c-9bd8-7e282f33cf2c of volume 81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[600a6637-ace3-4198-962c-8e4445d45f8a]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:01 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 Nov 02 18:08:01 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:01 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1" returned: 0 in 0.368s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:01 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:01 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c 1G Nov 02 18:08:01 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:02 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c 1G" returned: 0 in 0.545s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81118b88-7496-487c-97eb-fea58039a3b1 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:02 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81118b88-7496-487c-97eb-fea58039a3b1 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c Nov 02 18:08:02 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:02 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81118b88-7496-487c-97eb-fea58039a3b1 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c" returned: 0 in 0.313s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:02 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c is being set with open permissions: ugo+rw Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:02 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c Nov 02 18:08:02 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:02 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:02 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info Nov 02 18:08:02 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:02 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info" returned: 0 in 0.287s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:02 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info is being set with open permissions: ugo+rw Nov 02 18:08:02 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:02 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info Nov 02 18:08:02 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:03 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.info" returned: 0 in 0.293s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:03 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:03 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-a8d8013e-9cfc-45b4-9319-26818f8bed0d tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-9c3220e8-8e63-424c-9bd8-7e282f33cf2c-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-9c3220e8-8e63-424c-9bd8-7e282f33cf2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-81118b88-7496-487c-97eb-fea58039a3b1" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-81118b88-7496-487c-97eb-fea58039a3b1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-9c3220e8-8e63-424c-9bd8-7e282f33cf2c" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-9c3220e8-8e63-424c-9bd8-7e282f33cf2c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot 9c3220e8-8e63-424c-9bd8-7e282f33cf2c of volume 81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311036d-9cfe-4e01-987c-07f216c216e1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:04 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c Nov 02 18:08:04 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:04 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c" returned: 0 in 0.385s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81118b88-7496-487c-97eb-fea58039a3b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6114f95-b162-4bf5-9e6b-98deabed0634]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:04 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:04 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 Nov 02 18:08:04 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:05 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1" returned: 0 in 0.389s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:05 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c Nov 02 18:08:05 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:05 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c" returned: 0 in 0.407s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:05 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c Nov 02 18:08:05 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:05 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1.9c3220e8-8e63-424c-9bd8-7e282f33cf2c" returned: 0 in 0.285s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-9c3220e8-8e63-424c-9bd8-7e282f33cf2c" released by "_delete_snapshot" :: held 1.596s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-81118b88-7496-487c-97eb-fea58039a3b1" released by "delete_snapshot" :: held 1.622s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:05 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Created reservations ['85f76841-b866-4569-a410-abbe89917d6b', '2d639255-17a3-4a43-bc0b-60a8dc975acc', '194c73b1-3659-4b60-8331-7f8c31e4ab31', 'd1dab948-37e3-47ac-8493-ea299e58997a'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:06 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-5a490357-024b-4aee-9551-18a01d899e36 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-9c3220e8-8e63-424c-9bd8-7e282f33cf2c-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-81118b88-7496-487c-97eb-fea58039a3b1-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Lock "cinder-81118b88-7496-487c-97eb-fea58039a3b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-81118b88-7496-487c-97eb-fea58039a3b1" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-81118b88-7496-487c-97eb-fea58039a3b1" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8fe32d-b82e-4999-97f2-6fcb097f8185]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:06 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 Nov 02 18:08:06 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Flow 'volume_create_manager' (bff5292f-29f1-4943-90a0-62ed43f655eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f2698d-699a-4ebe-bacf-e2db54a98ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f2698d-699a-4ebe-bacf-e2db54a98ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2049531736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e8d019-d887-45ea-8c7c-464d0c09a38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb550007c90e49beaff5b3a92a841bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:07Z,use_quota=True,user_id='6f76848704d04e8e9e4f2368d487b1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a38c9c8-e7e5-4a93-84b3-d9669fdb0543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a38c9c8-e7e5-4a93-84b3-d9669fdb0543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59973f26-4daa-4fcf-8e61-c3486d8072b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59973f26-4daa-4fcf-8e61-c3486d8072b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e8d019-d887-45ea-8c7c-464d0c09a38d', 'volume_name': 'volume-97e8d019-d887-45ea-8c7c-464d0c09a38d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae613c9f-2ac2-45bc-bde2-bc2a4376528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae613c9f-2ac2-45bc-bde2-bc2a4376528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb2bb82-2f50-4fd8-b8b8-81e6ddc58786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:06 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Volume 97e8d019-d887-45ea-8c7c-464d0c09a38d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e8d019-d887-45ea-8c7c-464d0c09a38d', 'volume_size': 1} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2049531736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e8d019-d887-45ea-8c7c-464d0c09a38d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb550007c90e49beaff5b3a92a841bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:07Z,use_quota=True,user_id='6f76848704d04e8e9e4f2368d487b1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Creating volume 97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:06 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:08:06 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1" returned: 0 in 0.397s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:06 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:06 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d 1073741824 Nov 02 18:08:06 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:06 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1 Nov 02 18:08:06 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:07 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-81118b88-7496-487c-97eb-fea58039a3b1" returned: 0 in 0.253s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-81118b88-7496-487c-97eb-fea58039a3b1" released by "delete_volume" :: held 0.724s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Created reservations ['72ab0667-8c6b-4905-81fe-59a9ccd48959', 'a4cfac8a-3a9a-4a90-b8bb-77e4afb2bc65', '9552667e-307e-4c0e-8f9e-d55f740e58e7', '0e9e84b3-63bd-403b-ba39-faf7aa31dde3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:07 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:07 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:07 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d 1073741824" returned: 0 in 0.440s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:07 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d Nov 02 18:08:07 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:07 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.256s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-c95e6dc9-bee3-4292-83aa-167228ce72ef tempest-ProjectMemberTests-1879008254 None] Lock "cinder-81118b88-7496-487c-97eb-fea58039a3b1-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:07 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d" returned: 0 in 0.268s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb2bb82-2f50-4fd8-b8b8-81e6ddc58786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e8d019-d887-45ea-8c7c-464d0c09a38d', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56f8548-df77-43a8-a5a1-734c8bb01cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:07 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Volume volume-97e8d019-d887-45ea-8c7c-464d0c09a38d (97e8d019-d887-45ea-8c7c-464d0c09a38d): created successfully Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56f8548-df77-43a8-a5a1-734c8bb01cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:07 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Flow 'volume_create_manager' (bff5292f-29f1-4943-90a0-62ed43f655eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:07 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-56d503f2-2ee6-415c-b260-94c509a00eca tempest-SnapshotDependencyTests-3033853 None] Created volume successfully. Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (7e063145-dc5f-44f8-9b5f-03e2ddf2f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573ecabe-6c68-4249-88e5-7b99caabddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573ecabe-6c68-4249-88e5-7b99caabddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-147364950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185e94ee-9ca5-4504-9ac7-946eb22c97f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:08Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bb2601-5cf0-4882-9a95-ebe38a25985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10bb2601-5cf0-4882-9a95-ebe38a25985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13b5c9d-120b-4b03-adb8-df5a6063957b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13b5c9d-120b-4b03-adb8-df5a6063957b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185e94ee-9ca5-4504-9ac7-946eb22c97f0', 'volume_name': 'volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9683ada-abc9-4e6f-8a34-03d35e0f4759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9683ada-abc9-4e6f-8a34-03d35e0f4759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914b976b-2480-499d-af25-816c286fe905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Volume 185e94ee-9ca5-4504-9ac7-946eb22c97f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0', 'volume_size': 1} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-147364950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185e94ee-9ca5-4504-9ac7-946eb22c97f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b561b9c4f71454882eac42d565c1872',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:08Z,use_quota=True,user_id='56c2a7ca14994fc0a91d0ad1ca7bdb95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Creating volume 185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:08:08 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:08 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 1073741824 Nov 02 18:08:08 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:08 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 1073741824" returned: 0 in 0.424s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:08 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 Nov 02 18:08:08 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:08 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.674s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914b976b-2480-499d-af25-816c286fe905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d463cbc2-3e62-430a-9220-f59504a146a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Creating offline snapshot 453881e3-16b5-475b-8110-6c88cdc6e6f6 of volume 97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:08:08 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Volume volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 (185e94ee-9ca5-4504-9ac7-946eb22c97f0): created successfully Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d463cbc2-3e62-430a-9220-f59504a146a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Flow 'volume_create_manager' (7e063145-dc5f-44f8-9b5f-03e2ddf2f050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f74c63b-7d59-467e-941c-4d7cae9bcd94]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:08 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:08 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-f9bf9e63-c5b0-4fe0-9cf0-0118e98091f0 tempest-ProjectMemberTests-1879008254 None] Created volume successfully. Nov 02 18:08:09 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d Nov 02 18:08:09 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:09 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d" returned: 0 in 0.384s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:09 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 1G Nov 02 18:08:09 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:09 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 1G" returned: 0 in 0.383s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e8d019-d887-45ea-8c7c-464d0c09a38d -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:09 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e8d019-d887-45ea-8c7c-464d0c09a38d -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 Nov 02 18:08:09 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:09 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e8d019-d887-45ea-8c7c-464d0c09a38d -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6" returned: 0 in 0.276s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:09 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 is being set with open permissions: ugo+rw Nov 02 18:08:09 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:10 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 Nov 02 18:08:10 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:10 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6" returned: 0 in 0.236s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:10 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info Nov 02 18:08:10 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:10 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info" returned: 0 in 0.242s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:10 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info is being set with open permissions: ugo+rw Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:10 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info Nov 02 18:08:10 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:10 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.info" returned: 0 in 0.250s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.876s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.493s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Creating offline snapshot 75ef64de-c982-4a0d-b712-7f1b579e2d76 of volume 185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 18:08:10 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-4d04a3d0-94fd-459e-8c36-e15fc9f71098 tempest-SnapshotDependencyTests-3033853 None] Create snapshot completed successfully Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f593ac3-8270-4e65-b2e5-89c084a23ed1]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:10 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:10 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 Nov 02 18:08:10 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:11 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0" returned: 0 in 0.349s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 1G {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:11 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 1G Nov 02 18:08:11 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:11 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 1G" returned: 0 in 0.413s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:11 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 Nov 02 18:08:11 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:11 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 -F qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76" returned: 0 in 0.295s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:11 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 is being set with open permissions: ugo+rw Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:11 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 Nov 02 18:08:11 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Flow 'volume_create_manager' (e6657c46-e25f-4fb5-8209-ec2c5db85de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c394d62-1884-432f-96df-9171e0ae36f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c394d62-1884-432f-96df-9171e0ae36f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb550007c90e49beaff5b3a92a841bb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=453881e3-16b5-475b-8110-6c88cdc6e6f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:12Z,use_quota=True,user_id='6f76848704d04e8e9e4f2368d487b1f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189a015d-b81a-466f-a561-8fe91a25704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189a015d-b81a-466f-a561-8fe91a25704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59b447b-97c9-4dfa-ac94-94d55412305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59b447b-97c9-4dfa-ac94-94d55412305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da', 'volume_name': 'volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da', 'volume_size': 1, 'snapshot_id': '453881e3-16b5-475b-8110-6c88cdc6e6f6'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98aa0860-dee2-458e-bfa1-2f56df7435b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:11 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98aa0860-dee2-458e-bfa1-2f56df7435b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222114bd-d3c2-454a-b89c-980dcd34e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:12 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Volume 7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da', 'volume_size': 1, 'snapshot_id': '453881e3-16b5-475b-8110-6c88cdc6e6f6'} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:12 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76" returned: 0 in 0.238s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:12 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info Nov 02 18:08:12 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:12 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info" returned: 0 in 0.261s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:12 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info is being set with open permissions: ugo+rw Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:12 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info Nov 02 18:08:12 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:12 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.info" returned: 0 in 0.233s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.629s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-quobyte-453881e3-16b5-475b-8110-6c88cdc6e6f6-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" by "_create_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-453881e3-16b5-475b-8110-6c88cdc6e6f6-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Creating volume 7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da from snapshot 453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-quobyte-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" by "_copy_volume_from_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:12 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-b4d3a718-513c-4f31-851e-83772128fe84 tempest-ProjectMemberTests-1879008254 None] Create snapshot completed successfully Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] snapshot: 453881e3-16b5-475b-8110-6c88cdc6e6f6, volume: 7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da, {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[e645d263-440f-4d3d-a06a-d180f7df9e5c]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:12 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:12 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 Nov 02 18:08:12 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:13 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6" returned: 0 in 0.346s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e8d019-d887-45ea-8c7c-464d0c09a38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8301936-f451-43fc-99c7-39cb9cc40343]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:13 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d Nov 02 18:08:13 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:13 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d" returned: 0 in 0.365s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] will copy from snapshot at /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Creating direct copy from snapshot {{(pid=86585) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.utils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Path /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da not found in is_blk_device check {{(pid=86585) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:13 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da Nov 02 18:08:13 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-75ef64de-c982-4a0d-b712-7f1b579e2d76-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-75ef64de-c982-4a0d-b712-7f1b579e2d76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-185e94ee-9ca5-4504-9ac7-946eb22c97f0" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-185e94ee-9ca5-4504-9ac7-946eb22c97f0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-75ef64de-c982-4a0d-b712-7f1b579e2d76" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-75ef64de-c982-4a0d-b712-7f1b579e2d76" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Deleting offline snapshot 75ef64de-c982-4a0d-b712-7f1b579e2d76 of volume 185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] snapshot_file for this snap is: volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[705b61f0-1228-4a17-8459-0da40bc8b279]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:13 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:13 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 Nov 02 18:08:13 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:14 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76" returned: 0 in 0.456s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:14 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:08:14 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b26d7e-8763-4527-9ae5-53ff98c0a996]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:14 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 Nov 02 18:08:14 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:14 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0" returned: 0 in 0.727s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:14 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:14 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 Nov 02 18:08:14 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:15 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76" returned: 0 in 0.534s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:15 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76 Nov 02 18:08:15 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:15 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:15 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0.75ef64de-c982-4a0d-b712-7f1b579e2d76" returned: 0 in 0.367s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-75ef64de-c982-4a0d-b712-7f1b579e2d76" released by "_delete_snapshot" :: held 2.264s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:15 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-185e94ee-9ca5-4504-9ac7-946eb22c97f0" released by "delete_snapshot" :: held 2.295s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:15 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Created reservations ['b175152e-b265-43e2-8bb5-441be72719e0', 'caf1c3eb-c50f-4997-82cc-d19039154d10', 'e64eaa6e-b5af-4ec3-8cd5-200409ecb155', 'de946a4f-397a-44c6-9244-34a16f4c267c'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:16 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Delete snapshot completed successfully. Nov 02 18:08:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-71262498-5d69-45df-b8dc-ff98bbf31210 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-75ef64de-c982-4a0d-b712-7f1b579e2d76-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-185e94ee-9ca5-4504-9ac7-946eb22c97f0-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-185e94ee-9ca5-4504-9ac7-946eb22c97f0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "cinder-quobyte-185e94ee-9ca5-4504-9ac7-946eb22c97f0" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:16 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-185e94ee-9ca5-4504-9ac7-946eb22c97f0" acquired by "delete_volume" :: waited 0.025s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:17 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab779b5b-6c51-4de0-b9df-27f67ac08677]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:17 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 Nov 02 18:08:17 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:17 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0" returned: 0 in 0.656s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:17 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:17 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0 Nov 02 18:08:17 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:18 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-185e94ee-9ca5-4504-9ac7-946eb22c97f0" returned: 0 in 0.345s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-quobyte-185e94ee-9ca5-4504-9ac7-946eb22c97f0" released by "delete_volume" :: held 1.121s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Created reservations ['a0f6aea8-de6e-490b-936d-f99bbd2bff17', 'ae89744b-2ae0-4702-83c7-5c466cf121be', 'dcb6593d-ee06-4ded-8040-1171542ee819', 'e57e8eb7-b10c-47b0-84fa-304bc682e782'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:18 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:18 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:18 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.347s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:18 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Deleted volume successfully. Nov 02 18:08:18 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-57388680-c847-45af-99b3-dc89767494d4 tempest-ProjectMemberTests-1879008254 None] Lock "cinder-185e94ee-9ca5-4504-9ac7-946eb22c97f0-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:20 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" returned: 0 in 6.672s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.image.image_utils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Image conversion details: src /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da {{(pid=86585) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 18:08:20 devstack cinder-volume[86585]: INFO cinder.image.image_utils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Converted 1024.00 MB image at 153.46 MB/s Nov 02 18:08:20 devstack cinder-volume[86585]: WARNING cinder.volume.drivers.remotefs [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da is being set with open permissions: ugo+rw Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:20 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da Nov 02 18:08:20 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:20 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" released by "_copy_volume_from_snapshot" :: held 7.738s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-453881e3-16b5-475b-8110-6c88cdc6e6f6-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" released by "_create_volume_from_snapshot" :: held 7.803s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.830s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (222114bd-d3c2-454a-b89c-980dcd34e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da', 'volume_size': 1, 'snapshot_id': '453881e3-16b5-475b-8110-6c88cdc6e6f6'}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c38ee0-da0e-400d-8892-2bbb7a2bd470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:20 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Volume volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da (7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da): created successfully Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c38ee0-da0e-400d-8892-2bbb7a2bd470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:20 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Flow 'volume_create_manager' (e6657c46-e25f-4fb5-8209-ec2c5db85de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:20 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-0f657443-4ece-403f-86f5-102d3efbf7e5 tempest-SnapshotDependencyTests-3033853 None] Created volume successfully. Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-453881e3-16b5-475b-8110-6c88cdc6e6f6-delete_snapshot" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-453881e3-16b5-475b-8110-6c88cdc6e6f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-quobyte-97e8d019-d887-45ea-8c7c-464d0c09a38d" by "delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-97e8d019-d887-45ea-8c7c-464d0c09a38d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-quobyte-453881e3-16b5-475b-8110-6c88cdc6e6f6" by "_delete_snapshot" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-453881e3-16b5-475b-8110-6c88cdc6e6f6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Deleting offline snapshot 453881e3-16b5-475b-8110-6c88cdc6e6f6 of volume 97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] snapshot_file for this snap is: volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae278159-3805-48db-8318-90baf4665f9d]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:21 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:21 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 Nov 02 18:08:21 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:22 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:22 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e8d019-d887-45ea-8c7c-464d0c09a38d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86585) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 18:08:22 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[354237ee-d828-4bcd-a05f-f522bddba1dc]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:22 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d Nov 02 18:08:22 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:22 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d" returned: 0 in 0.528s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:22 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:22 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 Nov 02 18:08:22 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:23 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6" returned: 0 in 0.354s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:23 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6 Nov 02 18:08:23 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:08:23 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Flow 'volume_create_manager' (4b8a37b4-7906-40b2-8900-c0c865af12a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a978cc27-7aaf-4874-8813-33e227c28c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d.453881e3-16b5-475b-8110-6c88cdc6e6f6" returned: 0 in 0.283s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a978cc27-7aaf-4874-8813-33e227c28c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278333664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6295689b-9146-4874-bc9f-5e6fa3c308b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3e45184d2d49beb93ef770aed935f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:23Z,use_quota=True,user_id='1bfd57a86bac4b27b7244ce45063c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506ff1d8-c31e-463a-9e6d-1b0721d0e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (506ff1d8-c31e-463a-9e6d-1b0721d0e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e68ee2-a9c5-4494-a362-0d9c6c5d8d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e68ee2-a9c5-4494-a362-0d9c6c5d8d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6295689b-9146-4874-bc9f-5e6fa3c308b4', 'volume_name': 'volume-6295689b-9146-4874-bc9f-5e6fa3c308b4', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9375e95f-f3d9-4847-9716-63dacf29e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9375e95f-f3d9-4847-9716-63dacf29e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd6b750-a00c-4db4-bac7-3f6d365c1b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:23 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Volume 6295689b-9146-4874-bc9f-5e6fa3c308b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6295689b-9146-4874-bc9f-5e6fa3c308b4', 'volume_size': 1} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278333664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6295689b-9146-4874-bc9f-5e6fa3c308b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3e45184d2d49beb93ef770aed935f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:23Z,use_quota=True,user_id='1bfd57a86bac4b27b7244ce45063c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Creating volume 6295689b-9146-4874-bc9f-5e6fa3c308b4 {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:08:23 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:23 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 1073741824 Nov 02 18:08:23 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-453881e3-16b5-475b-8110-6c88cdc6e6f6" released by "_delete_snapshot" :: held 1.739s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-97e8d019-d887-45ea-8c7c-464d0c09a38d" released by "delete_snapshot" :: held 1.765s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Created reservations ['5f067039-5b0e-44ee-83e0-61746455a4ed', '3fd94ce1-c2ec-4840-9b07-7fb40bb354bf', '6ebc3c83-5131-41a1-a6d0-48601bbad944', 'd086c8e4-70fc-4305-9eae-f7d00ad1d7a3'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:23 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Delete snapshot completed successfully. Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2ab93bac-95cf-46eb-a5b0-7b46180c5630 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-453881e3-16b5-475b-8110-6c88cdc6e6f6-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-97e8d019-d887-45ea-8c7c-464d0c09a38d-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:23 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 1073741824" returned: 0 in 0.470s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-97e8d019-d887-45ea-8c7c-464d0c09a38d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-quobyte-97e8d019-d887-45ea-8c7c-464d0c09a38d" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:23 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 Nov 02 18:08:23 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-97e8d019-d887-45ea-8c7c-464d0c09a38d" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a8657-195a-4694-a19b-9b4cfcc361ab]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:23 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:24 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d Nov 02 18:08:24 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:24 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd6b750-a00c-4db4-bac7-3f6d365c1b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6295689b-9146-4874-bc9f-5e6fa3c308b4', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d68500d-b5d9-46a9-9f23-d5973d1cbc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:24 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Volume volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 (6295689b-9146-4874-bc9f-5e6fa3c308b4): created successfully Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d68500d-b5d9-46a9-9f23-d5973d1cbc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Flow 'volume_create_manager' (4b8a37b4-7906-40b2-8900-c0c865af12a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-cf73922f-b874-4670-ba1f-f0cad9735dd4 tempest-ProjectReaderTests-2033159096 None] Created volume successfully. Nov 02 18:08:24 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d" returned: 0 in 0.377s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:24 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d Nov 02 18:08:24 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:24 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-97e8d019-d887-45ea-8c7c-464d0c09a38d" returned: 0 in 0.245s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-97e8d019-d887-45ea-8c7c-464d0c09a38d" released by "delete_volume" :: held 0.690s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Created reservations ['33f0ae35-487f-461b-a76b-b10bf13cc96c', '148da4e1-6f11-4b1a-901e-95e08a1c3fed', '18519efb-8642-4c51-865d-62b3ef9616c7', '30812989-b005-4839-b1ea-273951b0f874'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:24 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:24 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:24 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.241s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:24 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:24 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Deleted volume successfully. Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-7fe54b35-babc-4459-b04c-5e4645dd1662 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-97e8d019-d887-45ea-8c7c-464d0c09a38d-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "cinder-quobyte-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" acquired by "delete_volume" :: waited 0.014s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1a9e23-f534-4438-a37b-d2793f7ef7fa]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:25 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da Nov 02 18:08:25 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:25 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" returned: 0 in 0.394s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:25 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da Nov 02 18:08:25 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "cinder-6295689b-9146-4874-bc9f-5e6fa3c308b4-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-6295689b-9146-4874-bc9f-5e6fa3c308b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "cinder-quobyte-6295689b-9146-4874-bc9f-5e6fa3c308b4" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-quobyte-6295689b-9146-4874-bc9f-5e6fa3c308b4" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8fbea0-6331-4d6c-8c1a-d7f2332d3a50]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:25 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 Nov 02 18:08:25 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:25 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" returned: 0 in 0.278s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-quobyte-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da" released by "delete_volume" :: held 0.723s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Created reservations ['1d80ab36-e1cf-44a3-96f8-d95141da5020', 'a04ff2da-8cb5-4509-98a3-dc3644e9532e', '098e5ea6-502d-4179-8a75-a293c4cd5cc2', 'c5445724-b060-4f91-8c6c-395bfef40afe'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:25 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:25 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:25 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:26 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4" returned: 0 in 0.398s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:26 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4 Nov 02 18:08:26 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:26 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.271s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Deleted volume successfully. Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-886136a2-7d6f-4032-b228-18065f733354 tempest-SnapshotDependencyTests-3033853 None] Lock "cinder-7b3fcdb4-3975-44e6-bf49-3bd3fc07e8da-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:26 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6295689b-9146-4874-bc9f-5e6fa3c308b4" returned: 0 in 0.293s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-quobyte-6295689b-9146-4874-bc9f-5e6fa3c308b4" released by "delete_volume" :: held 0.735s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Created reservations ['b9c2659c-c598-4151-baf3-8433cb0f5a7d', '44a56574-2191-47f3-be99-22983ac1b65e', '32db0df6-153b-40c1-9086-152c6606544c', 'c5f87112-8c50-47ff-8eb5-c1750f35f2a0'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:26 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:26 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:26 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.269s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:26 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Deleted volume successfully. Nov 02 18:08:26 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-abd28d60-df02-40eb-aa8c-7448b4001411 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-6295689b-9146-4874-bc9f-5e6fa3c308b4-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86585) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Flow 'volume_create_manager' (dda984e9-2b8c-464d-94b5-71991b43409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f8e077-bd44-4d59-b046-08e61afd55c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f8e077-bd44-4d59-b046-08e61afd55c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191161120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6926cc0d-a2c5-4d67-bbed-b90ac925228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3e45184d2d49beb93ef770aed935f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:27Z,use_quota=True,user_id='1bfd57a86bac4b27b7244ce45063c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32274826-1a2c-44d1-9f3c-508497a883ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32274826-1a2c-44d1-9f3c-508497a883ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a0386f-32eb-47ef-8db0-5509c34bcc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a0386f-32eb-47ef-8db0-5509c34bcc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6926cc0d-a2c5-4d67-bbed-b90ac925228b', 'volume_name': 'volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4d128f-aea0-4025-b8ea-04f3d23cfdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa4d128f-aea0-4025-b8ea-04f3d23cfdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b51f86e-a5c2-489a-aba9-3d0a2ad6c6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:27 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Volume 6926cc0d-a2c5-4d67-bbed-b90ac925228b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b', 'volume_size': 1} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T17:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-191161120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6926cc0d-a2c5-4d67-bbed-b90ac925228b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc3e45184d2d49beb93ef770aed935f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T17:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T17:08:27Z,use_quota=True,user_id='1bfd57a86bac4b27b7244ce45063c629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1b670da-5429-4784-a043-4456cc794475),volume_type_id=e1b670da-5429-4784-a043-4456cc794475)}" {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.remotefs [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Creating volume 6926cc0d-a2c5-4d67-bbed-b90ac925228b {{(pid=86585) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Selected osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 as target Quobyte volume. {{(pid=86585) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 18:08:27 devstack cinder-volume[86585]: INFO cinder.volume.drivers.remotefs [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] casted to osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6 Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b 1073741824 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:27 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b 1073741824 Nov 02 18:08:27 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:27 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b 1073741824" returned: 0 in 0.484s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:27 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:27 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b Nov 02 18:08:27 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:28 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'} {{(pid=86585) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b51f86e-a5c2-489a-aba9-3d0a2ad6c6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b', 'volume_size': 1}' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fedf7f-fe9d-4345-b9fb-f6a8352d5d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 18:08:28 devstack cinder-volume[86585]: INFO cinder.volume.flows.manager.create_volume [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Volume volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b (6926cc0d-a2c5-4d67-bbed-b90ac925228b): created successfully Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fedf7f-fe9d-4345-b9fb-f6a8352d5d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86585) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 18:08:28 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Flow 'volume_create_manager' (dda984e9-2b8c-464d-94b5-71991b43409a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86585) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 18:08:28 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-da0c38fb-527a-4fa5-8199-3cdd8d80ae78 tempest-ProjectReaderTests-2033159096 None] Created volume successfully. Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "cinder-6926cc0d-a2c5-4d67-bbed-b90ac925228b-delete_volume" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-6926cc0d-a2c5-4d67-bbed-b90ac925228b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "cinder-quobyte-6926cc0d-a2c5-4d67-bbed-b90ac925228b" by "delete_volume" {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-quobyte-6926cc0d-a2c5-4d67-bbed-b90ac925228b" acquired by "delete_volume" :: waited 0.018s {{(pid=86585) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a0ebe1-26d2-456f-855b-3c2902ceb68b]: (4, 'qcow2') {{(pid=88274) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:29 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b Nov 02 18:08:29 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:29 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b" returned: 0 in 0.399s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:29 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:29 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b Nov 02 18:08:29 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:30 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5/volume-6926cc0d-a2c5-4d67-bbed-b90ac925228b" returned: 0 in 0.265s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-quobyte-6926cc0d-a2c5-4d67-bbed-b90ac925228b" released by "delete_volume" :: held 0.716s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG cinder.quota [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Created reservations ['d1487da7-3426-4e6d-8e7d-b9cabc8f69f6', '8914accc-9575-403d-9f99-5e994815d751', '7ea8a025-ebb7-4c6c-9fd8-b835bc98e58c', 'a12c1c20-3b9c-48a3-8dd3-2650b1b3e973'] {{(pid=86585) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:30 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:30 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:30 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.311s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:30 devstack cinder-volume[86585]: INFO cinder.volume.manager [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Deleted volume successfully. Nov 02 18:08:30 devstack cinder-volume[86585]: DEBUG cinder.coordination [None req-2337f84d-20c0-4c25-9fae-d377f33d4254 tempest-ProjectReaderTests-2033159096 None] Lock "cinder-6926cc0d-a2c5-4d67-bbed-b90ac925228b-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86585) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 18:08:40 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=79,cinder:INSERT=28,cinder:DELETE=11,cinder:UPDATE=98 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:08:40 devstack cinder-volume[86585]: DEBUG dbcounter [-] [86585] Writing DB stats cinder:SELECT=76,cinder:UPDATE=105,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6': None} {{(pid=86585) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG cinder.volume.drivers.quobyte [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e4315ad-1c30-4761-bbf8-6d6f1bced5a6'] {{(pid=86585) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.lockutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86585) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 18:08:46 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5 Nov 02 18:08:46 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 18:08:46 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_concurrency.processutils [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/085a6907798d9a95e5f6d840796d7eb5" returned: 0 in 0.232s {{(pid=86585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG cinder.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Notifying Schedulers of capabilities ... {{(pid=86585) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG oslo_service.periodic_task [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] Running periodic task VolumeManager._thread_info {{(pid=86585) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread count: 28 {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 18:08:46 devstack cinder-volume[86585]: DEBUG cinder.volume.manager [None req-7a7b9d10-577f-487e-bf6b-3cf46d643ec5 None None] thread info: [<_MainThread(MainThread, started 124080962801792)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86585) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}